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1 Introduction 


Among the many possible norm-based optimization methods, the concept of 7/co -optimal 
control has gained enormous attention in the past few years. Attractivity of design methods 
based on the //<*,— norm is due to the fact that this methodology takes, in a direct and 
effective manner, unmodeled dynamics and other uncertain system parameters into account. 
Early LQ-based methods tried to account for these uncertainties by introducing, in addition 
to the real process and sensor noises, fictitious noises into the output and state equations of 
the linear plant model. This assumption led to the LQG design methodology using Kalman 
filters as the stochastic counterpart to the deterministic Luenberger observer. In most cases, 
however, the assumption of random noises entering the system having a certain distribution 
is not valid. 

Here the //^-framework, based on the Small Gain Theorem and the Youla- (Q-) 
Parametrization, effectively treats system un certa inties in the control-law synthesis. The 
/Z^-norm of a system can be interpreted as the maximum ''gain 11 of a transfer function 
in the frequency domain. The Small Gain Theorem then provides a pathway to define 
robust stability of a system to uncertain inputs in terms of the norm of this system. 
Under certain assumptions, the H fXf - bound control problem using full-state feedback and 
the observer- based (full or reduced order) //^-output feedback problem have been mostly 
solved. However, when such a solution exists, it is usually not unique. Namely, there exists 
an infinite number of controllers satisfying the given 77^-bound. The problem of actually 
minimizing the 7f lX *norm of a system has proven to be undesirable in many cases as it results 
in controllers with high gains or large control bandwidth. 

A design approach involving a mixed H 2 / 7/ x . norm strives to combine the advantages of 
both methods. The problem is to 

• Minimize the T^-norm of the closed-loop transfer function and thus minimize the RMS 
values of the outputs for a system driven by white-noise inputs, and at the same time 

• Keep the 77^-norm of the closed-loop system below a certain bound, or minimize this 
norm to gain robustness and account for uncertain exogenous disturbances that have 
a certain norm bound. 

This advantage motivates research activities toward finding solutions to the mixed 
control problem. In general, a mixed H 2 j -control can be termed as *LQG with robust sta- 
bility’, a property that regular LQG cannot provide. The problem of mixed H 2 / //^-control 
using state feedback or full and reduced order dynamic compensators has been addressed 
intensively over the past two years. Current research in this field will be discussed with more 
depth in Chapter 4. 

As in LQ-based methods, the TT^-control problem and the mixed H 2 / control problem 
with controllers of fixed structure and order remains a topic of current research. Some 
theoretical results have been found and numerical implementation of the solution algorithm 
remains difficult, mostly relying on approximations and numerical optimization methods. 
The most frequently used method for low-order controller design consists of first performing 
a plant order reduction which is then followed by a control-law synthesis using the reduced- 
order plant model. 


The approach developed in our research is based on a finite time cost functional that 
depicts an H, x - bound control problem in a /^-optimization setting. The assumption of a 
finite-time cost functional is very attractive as it allows the optimization process to start 
with an initial controller guess that is not necessarily stabilizing. Another motivation for the 
use of a finite time criterion in the mixed H 2 j H 0 0 - control problem as well as the H ^-control 
problem is the fact that, in steady state, existence of a controller is solely based on the 
solvability of certain algebraic Riccati equations. If a solution cannot be found, the method 
would break down with an unbounded objective function. The time-domain approach - and 
in particular using a finite-time horizon - offers more insights into the nature of the problem 
and provides a uniquely different, non-Riccati based controller design method. 

Finally, the nature of our research is toward a practical implementation of the H^- 
control algorithms for arbitrary fixed controller structures. We feel strongly that practical 
application has fallen short of all the existing theory in H '. x and mixed H 2 / H^- control. It 
is neccessary to develop algorithms that address practical problems faced by control design 
engineers and to provide design tools for this purpose in the fields mentioned above. Thus 
our attemps will follow a more application oriented line of research rather than a theoretical 

The goal is to define a time-domain cost function that optimizes the Hi - noim of a system 
with an H,^- constraint, function. With this cost functional and as tj -+ oo, a necessaiy and 
sufficient condition for \\H\\^ < 7 can be established where 7 is a prespecified parameter. 
Thus, for a finite tj the constraint provides 'information' for the //^optimization to yield 
the desired H^- bound. It is desired to append a possible //^-constraint either as a side con- 
straint (in form of an inequality) or, to incorporate the constraint directly into the function 
on which the mixed H 2 j H. x -control is based. The finite-time approach taken is advantageous 
due to the fact that no stabilizing controller is required in this procedure. Furthermore, for 
a finite terminal time, all considered functions in the cost functional and their sensitivity 
to design parameters are well behaved. The optimal controller will then be achieved in the 
limit of tj -> oc. In most practical situations, the iterative procedure converges to. a nearly 
steadv-state solution when tj is relatively large compared to the slowest time constant of 
the closed-loop modes. The resulting controller is then assumed to be an optimal solution 
for the steady-state case. Of course, after a controller has been designed, the norm bound as 
well as stability can be confirmed using the singular value and the eigenvalue analysis of the 
corresponding closed- loop system. It should be noted that when t.j is small, this approach 
does not guarantee stability (in contrast to methods based on the Youla parametrization) or 
satisfy the norm bound (as in methods based on algebraic Riccati equations). 

Organization of this research interim report is as follows. In Chapter 2 we go over the 
basic norm definitions and cover some preliminaries. In Chapter 3 the //^-theory leading 
to the mixed H 2 jH ^ problem is reviewed. Chapter 4 covers the most recent advances 
in mixed heory. Chapter 5 investigates an important cost function in the time 

domain. Chapter 6 addresses our approach to the mixed H 2 / //.^-control problem with an 
appended //co-bound constraint. The precise cost function for a mixed H 2 / H*,- control is 
defined. Chapter 7 discusses a possible algorithm for the numerical solution of the proposed 
cost function and the controller design. Finally, the remaining research work is outlined in 

It should be noted that review of the LQ-type /^-optimization theory falls short of 
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the coverage presented here for H lX ,- theory as /T- methods have been widely known. The 
significant part is the ff^-bound characterization. 

2 Norm Definitions and Preliminaries 

Let. G := (,4,B,C, D) denote a linear time invariant system as follows. 

[ x{t) = Ax(t) + Bw(t) , . 

‘ \ z{t) = Cx(t) + Dw{t) y 1 

Unless otherwise stated, the initial condition x(0) of the system is assumed to be zero. Then 
the transfer function G'(s) from w(s) to ; ( s ) is given by G(s) = C(s / — A)~ l B + D. 

2.1 H -2 and H . x : -Norms and their Properties 

Before the actual norm definitions are stated, we define two important frequency-domain 
spaces. 

• The frequency- domain space Hi = F/jfs, C mXn ) consists of all matrix functions 
F(s) 6 C mXn of a complex parameter s which are analytic in the open right-half 
plane (that is /?e(s) > 0, Re(.) denotes the real part of the argument) and fulfill 
su P s ,He( s )>o f?L F*{s)F($)ds < oo. That is H 2 {s,C mxn ) contains all asymptotically 
stable transfer functions G(s) that are strictly proper {D = 0 in (1)). 

• The Hardy space - a frequency- domain space - H ^ = H.- x ,{s,C mXn ) consists of all 
matrix functions F(s) € (7 mxn of a complex parameter s which are analytic in the open 
right half plane (that is Re{s) > 0) and fulfill d’[F(s)] < oo VFe(s) > 0 where a{.) 
denotes the maximal singular value. That is, i/ lX ,(s, C ,mXn ) contains all asymptotically 
stable transfer functions G{s). 

L qq ( T 2 ) contains H^(H 2 ) and represent functions F(s) E C myn that are bounded on 
the ju-’-axis and proper (strictly proper), stability is not required for these spaces. 

• Besides these frequency-domain spaces the most important norrned space in the time 
domain is L 2 { 3?) where 3? represents real numbers. T 2 (9i) represents all square inte- 
grable scalar functions of time g{t) € with = J? x [g(t)} 2 dt < oo. For simplicity- 
in notation, we will use L 2 to stand for both, the frequency domain as well as the time 
domain space. The exact domain will be clear from the context where it is used. 

• The prefix R denotes real-rational elem ents o f the according frequency-domain spaces. 
That is, RH 2 and RH, X denote real rational elements of H 2 and respectively. 

With the above definitions the following norms can be derived. 
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2.2 Hi - Norm of a System 

Definition 2.1 Let the system G:=(A,B,C,0) be stable and strictly proper, then 

|ICt H2 = / Trace[CT{ju;)G(juj)}du 

Z 7 T J- 00 

= 

2 7 T J-00 

= r < 2 ) 

2tt i-^ t=1 

where ||.|| F den otes the Froebenius norm of a transfer function. Equivalent ti me-do main 
definitions can be established using Parseval’s theorem. A very important interpretation of 
the 2-norm of a system is given in terms of a measure of the output response of a system hav- 
ing white noises as input disturbances. A characterization of the 2-norm in these stochastic 

terms can be put as follows. 

Definition 2.2 Let the system G:=(A,B,C,0) be asymptotically stable and strictly proper. 
Let w be a white-noise disturbance input with unit spectral density S ww (joj) = I ■ Then 

\\G\\l = lim S[z T (tj)z(tj ) ] (3) 

11 11 * t f — +OO 

where £ represents the expectation operator, 

A very convenient way to compute the 2- norm of a transfer function is via the observ- 
ability grammian 1 1 0 or the controllability grammian \V C making use of the time-domain 
definitions of the 2-norm. They are defined as follows. 

Definition 2.3 Consider the system G:=(A,B,C,D) with ,4 asymptotically stable, (A,B) 
stabilizable and (AX') observable, then 

W 0 = e ATt C T Ce Al dt (4) 

Jo 

W e = r e M BB T e ATt dt (5) 

JO 

Obviously these two matrices can also be computed via a Lyapunov solution. Now the 
2-norm of a transfer function can be expressed in terms of W 0 and W c . 

Definition 2.4 Let the system G:=(A,B,C,0) be asymptotically stable and strictly proper, 
then 

||Cr III = Tract{B T W 0 B] (6) 

= 7Yace[CTE c (7 7 '] (") 
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2.3 iJoo-Norm of a System and Some of its Properties 

For transfer functions G(s) 6 H^, the /Go-norm is defined as follows. 

Definition 2.5 Let the system G:—(A,B,C,D) be asymptotically stable, then 

Halloo = Sll P A[<S'*(.S )<S'(-5)] b) 

s , He ( 5 ) > 0 

where G*(s) denotes the conjugate complex transpose of G(s) and A(.) denotes the maximum 
eigenvalue of the argument. Unless otherwise stated, H-Hoo will denote the norm defined on 
// x rather than L x . As the Hardy space defined above is a Banach space, the above 
definition can alternatively be stated as, 


Definition 2.6 Let the system G:=(A.B,C,D ) be asymptotically stable, then 

||G||^ = sup\[G m {juj)G(juj)], 

jJ 


( 9 ) 


that is, an actual computation has to be performed on the imaginary axis only. A computa- 
tional algorithm to compute the norm - not e xactly but as close to the norm as desired 
- is due to Bo\ f d [ 2 ]. 


Definition 2.7 Let the system G: = (A,B,C,D) have no poles on the jio-axis and define the 
Hamiltonian matrix, 


( A + BR~ X D T C yBR~ l B T 
{ —yC T S~ l C -A T -C T DR-'B T 


( 10 ) 


where R = {y 2 I - D T D) and S = b 2 1 - DD T ). 

Theorem 2.1 ([2]) Let A be asymptotically stable and 7 > a(D), then HG'H^ > 7 4=4- M-, 
has at least one eigenvalue on the imaginary axis. 

This theorem provides a convenient wav to compute the -00- norm of a system by iterating 
on 7. Starting at a large value for 7 > d(D) the eigenvalues of the associated matrix AG are 
computed. If A/-, has no purely complex eigenvalue, then the chosen 7 is larger than ||G||oo 
and we can lower 7. The iteration terminates when the largest 7 is found for which has 
a purely complex eigenvalue. Note that in the case where A is not asymptotically stable but 
has no Ju^’-eigenvalue, the above theorem represents a characterization of the G x - noi m of 
the same transfer function. 

An equivalent theorem expresses the same condition in terms of certain algebraic Riccati 
equations (ARE). 

Lemma 2.1 ([47] [57]) Consider a system G:=(A,B,C,D) with A asymptotically stable, 
(A,C) observable, ( A,B ) controllable and 7 > a{D), then the following statements are equiv- 
alent: 


l. 


(U) 



A/, has no eigenvalues on the imaginary axis 


(12) 


3. The ARE 

\A t + C T DR~ l B T ]X i + Xi[A + BR~ x D t C) + 7 X 1 BR~ l B T X l + yC T S~ x C = 0 (13) 

has a unique real positive definite solution Xi - Xfi such that A+BR X {D T C +~fB T Xi ) 
is asymptotically stable. 

4 . The ARE 

[A T + C T DR~ x B T )X i + X.,[A + BR-'D T C ] + 1 2 X 2 BR~ 1 B T X 2 + C T S~ l C = 0 (14) 

has a unique real positive definite solution X 2 = Xfi such that A + BR l (D T C + 
y 2 B T X 2 ) is asymptotically stable. 

5. The ARE 

[.4 + BR-'D T C]X, + .\' 3 (.4 7 + c t dr-'b t ) + i 2 x 3 c t s-'c: y 3 + br~'b t - o ( 15 ) 

has a unique real positive definite solution A 3 = A J such that .4 + ( BD + 
~f 2 X^C T )S~ l C is asymptotically stable. 

This theorem is an extension of lemma 2.3 in [47] and equation 5.43 in [57] for the proper 
case rather than the strictly proper case. It can be easily derived using the identities 
y, = ,Y 3 - yJ.Vi ' 1 and /? _, D r = D T S~ x . Note that the notion of existence of 

a. solution to the above ARE’s means that the matrices A'i, X 2 and A ' 3 are bounded; that 
is, any matrix norm applied to them is finite. 

A similar characterization of the norm was derived by Zhou, Khargonekar and Peteisen 
(see e. g. [21]) in terms ol a Riccati inequality (also termed Quadratic Matrix Inequality 01 
QMI by Willems [53]). The QMI represents the fundamental tool for the //.^-design method 
developed by Zhou, Khargonekar and Petersen. 

Lemma 2.2 ([21], Lemma 2.2) Consider a system G:=(A,B,C,D) with A asymptotically 
stable and 7 > cr{D), (A.B) stabilizable and (C,A) observable, then the following two state- 
ments are equivalent: 

Moo < 7 

2. There exists a real positive definite symmetric matrix X 4 such that 


( 16 ) 
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Because this representation is the basis for a very general approach to the H ^- norm bound 
control problem [46], the proof is briefly outlined here. 

The system considered is of the form G := (.4, /?, C, D) with A asymptotically stable. 
Assume that ||G|j,x < 7 which implies that R and S as defined above are positive definite. 
Now a unitary transformation U is applied to the system. 



where and u'\ are the new output and input vectors (for a complete discussion ot 
this transformation, see [ 66 ]). It can be shown then that this transformation leads to a 
strictly proper system Ghv [A^, B^,C a \,0). Since U is unitary it is easy to show that 
|| G' H^o <7 4 ^ 1| GW Hoc, < 7 - Applying Lemma 5 from Willems ([53]) the desired result fol- 

lows immediately using the fact that A is asymptotically stable and a result from Lyapunov 
stability theory. 


Note the term C T {I + DR~ X D T )C can be written as C T (I + DR X D T )C — 7 2 C T S l C so 
that the above inequality can also be stated in the following form, 

[, 4 r + C' t DR- 1 B t ] A'., + \\[A + BR~ x D t C) + X 4 BR~ ] B T X 4 + 7 2 C T S~ 1 C <0 (18) 

From these norm definitions and norm bound characterizations, it can be seen that the 
whole concept of //, x is set in the frequency domain. However, there are possible time 
domain characterizations of the norm that are useful in many' respects. 


2.4 A Time-Domain Characteri za tion of the JToc-Norm 

Definition 2.8 Consider a system G:=(A,B,C,D ) with A asymptotically stable, x (0) = 0 
and w(t) G L 2 , then 


H 


2 

■x 


sup 

sup 

«',||Hh=i 


/ 0 " 

lim — r 

x ' f 0 / w T [t)w[t)dt 

Mi 

11 ^ 11 2 . 


(19) 

( 20 ) 


This is a definition of an operator norm induced by. the 2-norm in the input and output 
space, other restrictions on w(t.) are possible (see e.g. [65]). Physically this norm can be 
interpreted as the ratio of L r norms of output vector and input vector (The restriction 
||f ( .|| 2 = 1 can always be achieved by scaling as long as w(t) € L 2 )- Note that the function 
w(t) = wexp(ju>ot ) would achieve this norm for some u-'o and w. However, periodic signals 
do not have a finite L^-norm and are therefore excluded from the above definition. An 
important observation concerning this time-domain definition - but with a finite hoiizon 
time - has been made by Boyd |2],[3]. Namely, 

Theorem 2.2 Consider a system G:~(A,B,C,D) with .4 asymptotically stable, x(0) — 0 and 
w{t) ^ 0, w{t) € L- 2 , then \/tj > 0, 

T z T (t)z{t)dt < \\H\\l ^ w T (t)w(t)dt 
Jo VO 


( 21 ) 
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Importance of the finite-time cost function (20) is not based on the fact that it represents a 
lower bound for the H^- norm, but in its relationship to a cost function to be defined later. 
Finally, shown in this section are a few properties of the //^-norm that are important for 
the further development and these are standard results of the operator-norm definition (see 
e.g. [65]). Consider two transfer functions G and H , 

iiqu > o, ||Ct||. x . = o iff G— o 

||oG|U=|q|||G|U 

||G , + //|| J o<||6’|U + ||//1U 

||c;//|U < IK'lk Plk 


2.5 Signals with Bounded Power and Bounded Spectrum 

This section reviews some of the concepts important behind the approach of Doyle, Zhou and 
Khargonekar to the mixed F/ 2 /FFxr control. The signals considered are time-domain signals 
that can be vectors in general. For this purpose, let us define the following functions. 


Definition 2.9 

defined as 


The cross-correlation R uv (t) between two tune-domain signals u and v is 


R U u{r) 


lim t— f ’ u(t + T)v T {T)dt 

l i 2 tj J-tj 


( 22 ) 


if it exists and is finite Vr. 


The Fourier transform ot /? ui ,(t) is called the cross-power spectral density S U v(j and is 
defined as follows. 


Definition 2.10 The cross- 
u and v is defined as 


power spectral density S uv {jw>) between two time-domain signals 

SuAjs) = f° R»„(T)'-’- T dT (23) 

J — oo 


Remarks: 


1. The autocorrelation as well as the power spectral density of a signal u{t) are defined 
accordingly. 

2. It can be shown that 


Ruu{t) 

= RU-r)> 0 

(24) 

RuA t ) 

= RlX-r) 

(25) 

Suuij u) 

= Slfiju;) > 0 

(26) 

SuvUu) ■ 

= 

(27) 


Now two sets of signals with bounded power and bounded spectrum aie defined in the spnit 
of Doyle, Zhou and Bodenheimer ([14], [15]). 
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Consider a set of vector- valued functions u{t) that satisfy 
BPi : u(t) is finite for all t, 

BP 2 : Ruu{t) exists and is finite for all r 
BPy. S uu (joj) exists (not necessarily bounded) 

Now the following two sets are defined. 

Definition 2.11 ([14]) The set of vector valued functions u(t) with bounded power will be 
denoted by P, 

P := {u(t) : u(t) satisfies BP\. B P 2 and BPz] 
with the semi-norm 

||ti||p 5 = lim — — / u T (t)u(t)dt 

tj~00 2 1 f J-tj 

= Trace {Ru u (0)} 

= ^- j Trace {S uu (juj)}duj (28) 


defined on the set P . 

Similarly the set of all signals with bounded spectrum is defined as follows. 

Definition 2.12 ([14]) The set of vector-valued functions u{t ) G P with bounded spectrum 

will be denoted by S, ... 

S := {u{t) : u{t) G V. |j5 uu ||,^ < oo} 

with the semi-norm 

||«||s = ||5uu(i u - , )||oo (29) 

df fined on the set S. 

Remarks : 

1. Note that all I 2 -signals (in the time domain) have zero power, so do all time limited 
signals. 

2. White noise is not a member of S as its auto-correlation is infinite at r = 0. White 
noise in S is comparable to periodic functions in L 2 - 

3. Let the prefix B denote the closed uni t ba ll, that is BP denotes the set of signals u 
with bounded power and semi power norm j|u||p < 1, accordingly for BS. 


4. Note also that S C P- 
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2.6 Some Game Theoretical Results 

In this section some important results from game theory are reviewed. They are important 
for the interpretation of the proposed H 2 /H^-c ost function and for the numerical algorithm 
to compute the desired controller. 

Consider a min- max problem of the following form, 

J{4>o, i/'o) = inf sup (3°) 

4 > ^ 

where <p 0 represents the optimal minimizing strategy and ip 0 the optimal maximizing strategy 
in this game. Without any assumptions on concavity or convexity, the following results can 
be obtained, 

sup inf J(<p, i') < inf sup J(0, ■«/’) (31) 

ifi $ & V* 

This is easily verified and is a standard result in game theory. Another important concept 
in game theory is that of a ’saddle point strategy which - in mathematical teims - can be 
stated as follows. 

Definition 2.13 A pair o 0 and < p 0 C called a saddle point strategy of the inf-sup problem 
infp sup^, ./(<?, </’) if 

J{6q. if) < J{ep o- ii’o) £ J{4>,i'o) V0 € $ and VC £ C (32) 

If a saddle point exists, then the ’inf’ and ’sup’ operators can be interchanged and ’inf sup’ 
is equivalent to ’sup inf’: but the reverse is not necessarily true. However, in general such a 
point does not always exist. Various necessary conditions have been established to guaiantee 
the existence of such a point, but most ot these conditions assume convexity of J{<p,if) > n 
<p and concavity of J(<t>,f) in tp as well as continuity and convex compactness of the spaces 
$ and 'f. In many cases, however, these assumptions are very restrictive and cannot be 
satisfied so that the existence of a saddle point cannot be guaranteed. 

In general if one obtains the solution of a min- max problem via some method, it has to 
be verified in each case individually whether or not these solutions fulfill the definition of a 
saddle point as stated in definition 2.13. The importance of a saddle point strategy can be 
appreciated by looking at it as a true, simultaneous minimization and maximization while 
min- max or max- min always implies a certain order and thus an advantage/ disadvantage to 
either the minimize!' or the maximizer. Other important concepts such as ‘e-optimality or 
'saddle point strategies in equilibrium’ are not reviewed here. For a brief review see [33] and 

[29]. 

It is recognized that most min-max problems do not have optimal solutions that represent a 
saddle point. In a paper by Salmon ([45]), he has given an approach to the min-max pioblem 
from a different point of view. His objective was to find a solution to the following pioblem. 

Definition 2.14 ([45]) Let J{<f>,i') be a scalar-valued function that is non-negative, con- 
tinuous in lice At and continuous in <f> 6 $ where At and $ represent closed and bounded 
domains. Let <j>* denote the minimizing strategy of 4> and define the following min-max 
problem, 

max J(f, i/’) = min max ip) (33) 
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for which he found an iterative algorithm that is guaranteed to converge to 
min 06 <t max^.gip 7(0, 0) using a sequence of successive minimization and maximization steps 
only (under certain assumptions). His algorithm and some of its properties are stated here 
without proof, a complete discussion can be found in [45]. 

Assumptions: 

1. Continuity requirements: 7(0,0), ^{7(0,0)} and j|^{7(0, 0)} are continuous in 0 

and ip. — 

2. For each 0 € 0 there is an optimal Q° ( 0 ) E 4> such that 7(0°(0),0) = 7°(0') where 
J°(ip) is the minimal value achievable by <p. This means that the minimizer can generate 
the optimal minimizing strategy for any 0. 

3. Let (/rac/ <!) J(0, 0) = 0 and let the 0, 0 satisfying this condition be denoted by 0 and 0. 
Then it is assumed that .7(0,0) = J°{ 0). 

Salmon’s algorithm: 

1. Initialization: __iz: 

Choose an initial set To = {0io- 02cn ••• }• 

2. The n th - iteration: 

Perform: min 0 ^{ max^.g*,,., .7(0, 0)}. 

Let 0" denote this minimizing strategy. 

Define 70 = max^.^^, .7(0", 0). 

Perform: max vf {.7(0 n , 0)}. 

Let 0 n denote this maximizing strategy. 

Define 7„' 7 — 7(o”,0 n ). 

Dehne T„ = T n _i U {0 n }. 

3. If \J„ ! - 70 1 < f then stop 
Otherwise repeat step 2. 

Remarks: 

1. Salmon has shown in [45] that 

.7, m < min^ 6 $ max c , e ,( 7(0,0) < 70 lor all i — 1,2,.. 

2. If above assumptions are satisfied, then the sequences {70} and {7/ u } converge to 
min 0e< j, max^.gvj, 7(0,0) in a finite number of iterations. 

3. If there are no min-max strategies in the interior of the correponding domains, then 
the algorithm will converge to min-max strategies on the boundary of these domains. 

4. Pure continuity of 7(0,0) is sufficient to show that 70 is a monotonically increasing 
function of i. This is based on the fact that we minimize the objective function over 
an increasing set T ( . 
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5 . This algorithm does not guarantee convergence to a saddle point. Instead, it converges 
to a min-max value as defined in the definition 2.14. Also, the resulting min-max value 
as well as the resulting min- and max-strategies depend on the choice of the initial set 
$0 (if no global minimization and maximization algorithms are applied). If 
is convex/concave in its parameters (p and 0 respectively, then the solution will be 
unique; if the min-max problem does in addition have a saddle point solution then this 
algorithm will converge towards this point as in this case min-max equals max-min. If 
convexity/concavity is not given, this algorithm might converge to local saddle point 
strategies (if saddle point strategies exist at all). 


3 H ^.- Analysis and Synthesis 

The whole concept of // x . -analysis is based on the 'Small Gain Theorem' and the represen- 
tation of a system with its uncertainties in a special form called the Q-parametrization (or 
You la parametrization). The synthesis on the other side can be approached via factorization 
methods in the frequency domain or a game theoretical approach. Before we illustrate this 
concept, we will review how one can use H .^- norm formulation to include system uncertain- 
ties into the analysis and design. 


3.1 Uncertainty Representation and the Small Gain Theorem 

In terms of notation, this section will follow the notation ol [63]. Let A ; and Ao denote 
multiplicative system perturbations in the input and output respectively, and A a the additive 
system uncertainties. The perturbed transfer functions can be repiesented as 


G(s) = Go{s)[I + A t (s)] 

(34) 

G'(.s) = [I + A 0 (s)]Go(<s) 

(35) 

G[s) = Gq[s) + A a (s) 

(36) 


where G 0 (s) represents the nominal system and the disturbances A ( . } are norm bounded in 
the // iX .- sense; that is, ||A(.)||. X , < 7 . Note that possible uncertainties contained in this repre- 
sentation include parametric model uncertainties, non parametric plant uncertainties (such 
as transfer function perturbations due to identification errors), or neglected nonlinearities to 
name a few. Note also that the norm assumption implies that the disturbances are required 
to be stable, e.g. A ( .) € RH^. Now we can rewrite this system as follows, 

~(s) = M(s)w(s) (37) 

u>(s) = A(s)z($) ( 3§ ) 

where A(s) contains all the uncertainties and M{s) represents the undisturbed system model. 
At this point, we do have to distinguish between ‘structured’ and ‘unstructured’ uncertain- 
ties, implying that the A(s) block has a- structure that is known (i.e. structured) or, that 



14 


nothing but the norm bound is known and th ere is no need to define its structure (i.e. un- 

structured). The first kind of uncertainties leads to /r-synthesis while the second type of 
uncertainties leads to the H <X/ - framework. Let us assume that || ||oc. < 1 (this can always 
be achieved by scaling). 

Equations (37) and (38) represent a ‘feedback ’" connection of M(s ) and A(s) to which we 
now can apply the Small Gain Theorem. For this purpose consider the following system 

z(s) = M(s)[w(s) + r(s)} (39) 

w{.s) = A(s)z(s) (40) 

where r(s) represents an auxiliary signal. Then 

\\=(s)h = ||M(s)r(s) + M(s)A(s)z(s)|| 2 

< ||M(s)r(s)|| 2 + ||M(s)A(sMs)|| 2 

< \\M(s)\\- IH*)lh + |iM(s)|U ||A(s)|U \\z(s)h 


Thus, the following identity is true, 

llsMIl, < 


Moo 


1 - ||.l/(.s)i| x , ||A(.s)||, x . 


\Hs)b 


Now the Small Gain Theorem can be stated as follows. 

Theorem 3.1 Consider the feedback system formed by M ( s ) and A(.s) with M(s) G 
and A(.s) G H . x . then we have the following statement , 

•*||A/(s)|U||A(s)|U < 1 =* The closed loop system is stable (of bounded gain)". 

It should be noted that the Small Gain Theorem is valid for other transfer function norms as 
well since the main result is that, the system has 'bounded gain’ in the closed-loop feedback 
configuration. Note also that this theorem doe sn ot give an 'if and only if’ relation; hence it 
mav be conservative. This conservatism can in fact, be removed using the /./-framework. 

3.2 The General Setup for H . x - Analysis and Synthesis 

The frequency dependence of signals and transfer functions is omitted throughout this section 
for ease of notation. It has to be kept in mind, however, that all considered transfer functions 
are real, rational functions of s (except for matrices in the state-space realization). Consider 
now a plant description in the frequency domain as follows. 



Remarks : 

• The input vector w contains the exogenous inputs which include signals such as dis- 
turbance inputs or noises acting on the plant from ’outside’, fictitious noise inputs 
to achieve certain design specifications, actuator or sensor noises as well as command 
inputs. 
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• The input vector u is the control input and represents all inputs that can be used to 
control the plant. 

• The output vector z contains all variables that are to be regulated. That is, it contains 
outputs that are fed back through a A- block to the input w. In general one would like 
to keep these signals as ’small’ as possible. A sample of the elements of z consists of 
variables such as errors between a real output and its commanded value, system states, 
components of the measurement output y or specific control inputs u, as well as other 
linear combination of these signals. Weighting factor can be frequency dependent or 
pure scaling. Other fictitious A-blocks between outputs z, and w can be formulated 
to incorporate robust performance. (Note: Some weighting functions or additional 
A-blocks for robust performance may already be imbedded into the above model). 

• The output vector y contains all variables that are measurable and thus accessible to 
the controller (i.e. sensor outputs). 

It is very important to clearly identify the signals used in the optimization model for the 
//-o- framework. Let us now assume that a state-space representation of the above system X) 
is given as follows. 

x{t) = Ax(t) + + B 2 u{t) 

£ : < z(t) — C\x{t) D\iw(t ) + D\ 2 u{t) ( 42 ) 

y(t) = 0 2 x(t) + D 2 l w(t) T ^22 u (0 

so that a state-space representation of each component P tJ is given by 

P u := (A, B].C\, D\\) 

p P \2 (d, B 2 , Ci, D u ) (43) 

P 21 :=(A,B U C 2 ,D 21 ) 

, P 22 ( A, B 2 , C 2 , D 22 ) 

The general objective in the methodology is to find a stabilizing contiollei A(s) with 
u(s) = K(s)y(s) that minimizes the H, x - norm of the transfer function T zw ($) from u>(s) to 
r(.s) (or to keep this norm below a certain prespecified value for robust stability in the face 
of the uncertainties A). 

Note that in general the open-loop system P(s) may be stable or unstable. In the case 
of an open-loop system, the first step is to find all the controllers that will stabilize the 
closed-loop system and then look for one that satisfies the H^- bound constraint. 

It is easilv verified that the closed-loop transfer function T :w [s) with the contioller A(s) 
in place can be written as 

T zw {s) = T{ P, K) = Pu + P\ 2 (J - P22 ) ~ X P2 1 ( 44 ) 

3.3 Q-parametrization and All Stabilizing Controllers 

A complete treatment of this problem would require extensive use of factorization methods 
whose details are omitted here for brievety. Only the major steps that lead to the \oula (Q-) 
parametrization will be outlined. Before we do that, the notion of stabilizability of P"(P, A ) 
has to be defined. 
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Definition 3.1 T(P , K) is stabilizable if there i-s a A for which J-(P, A ) is internally stable. 
If such a K exists we will say that A' stabilizes P. 

For a discussion of internal stability in the sense of Desoer and Chen (see e.g. Francis [62], 
[63] or [57]). Note that stabilizability of P does not necessarily means that P n has to be 
stable, however, if P n contains unstable modes then these modes have to be observable 
through y and controllable through u (i.e. the controller has to be able to stabilize these 
unstable modes). This implies that (C2,.4) needs to be observable and (4, Pi) needs to be 
controllable. These are taken as standard assumptions in the //.^-literature. 

The following theorem shows that it suffices to concentrate on P 2 2 only, rather than on 
the whole P. 

Lemma 3.1 ([62]) Let P 2 - 2 •— ( .4. B 2 , C 2 , D > <) with ( .4 , B 2 ) controllable and (.4, C 2 ) observ- 
able, and furthermore I\ and P 22 are proper transfer functions. Then A stabilizes P iff A 
stabilizes P 22 . 

Before we proceed, let s state some results obtained from factorization, namely right and left 
coprime factorizat ions and doubly coprime factorizations. 

Definition 3.2 ([63]) Consider two transfer function matrices F,CI £ RH.^ where F and 
G have the same number oj columns . then F and G are right-coprime over R // (X , iff there 
exist X , 1 £ RR.x, such that 

XF + YG - /, ' (45) 

equivalently, for the left coprime factorization, 

Definition 3.3 ([62]) Consider two transfer function matrices F,G £ RH where F and 
G have the same number of rows, then F and G are left- coprime over RH lX , iff there exist 
X , V £ RH CC , such that 

FX + GY = l (46) 

These two identities are also called the Bezout or Diophantine equations. Note that state 
space realizations of coprime factors are readily available but are not included heie, see [62], 
[63]. Finally we define the doubly coprime factorization. 

Lemma 3.2 ([62]) For each proper real- rational matrix G there exist M, M, N , N, X, X, 
Y and Y (all of these matrices in RH .^) such that: 

G = N M~ l = M~ X N (47) 


X -Y 

-N 


M Y 
N X 


I 0 
0 / 


and 


( 48 ) 
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With these factorizations defined, their implications can now be addressed. Let G be a 
proper real rational transfer function, then there are factorizations G = NM~ l and G = 
M~ l N where N and M are right coprime (in RH^) and N and M are left coprime (in 
RHfx,)- A doubly coprime factorization finally implies right coprimeness of N and M and 
left coprimeness of N and \I . Let right and left coprime factorizations be abbreviated by 
ref and lef respectively. 

The following theorem establishes the connection between the described factorizations 
with the original H,^.- problem. 

Theorem 3.2 ([62]) Let I< 0 be a .stabilizing controller and define 

p n = NM~ X = M~'N (49) 

I<o = UoV 0 -'=%-'Uo (50) 

where M, M, -V, -V, f 'u, C 0 . V’o and L 0 represent lef and ref of P n and I\ 0 then the following 
statements are equivalent: 


l. A stabilizes P 


M V o 

-V Vo 


6 RH*. 


Furthermore, the set of all proper stabilizing controllers K is given by: 

l< = A 0 + V 0 ~'Q(I + V 0 -'NQ)~ l V 0 -' 


= {U 0 + MQ){V 0 + NQ) 


-1 


(51) 

(52) 


with Q <E A// x such that (/ + V Q 1 .YQ)(oo) is invertible ( (.)(oo) denotes the high-frequency 
gain. i.e. value of the transfer function as s — > oo). 

It is easy to show now that the closed-loop transfer function can be represented as 

JF(P, I<) = Pn + Pu{I ~ Pi 2 A ')" 1 Pn 

= F{T,Q) 

= Tn+T u QTn ( 53 ) 

This is the key result of Youla (Q-) parametrization. Now the original problem is to find a 
Q such that 

||r„ + TnQTz , ||. x . < 7. Q 6 RH^ (54) 

Remarks: 

1. Note that Q is - in general - a transfer function that is restricted to be in RH 0 0 . That 
is, it is required to be proper and asymptotically stable. Note also that lF{T,Q) is 
affine in Q. 
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2. (/ + V 0 ~ l .YQ)(oc) invertible is equivalent to having (I + D 22 Q( og)) invertible. This 
condition is termed ‘well posedness 1 (see e.g. [61]). It reflects the necessity that for 
non strictly proper controllers the problem is well posed Vs. 

3. The factorization results used in this presentation are useful as they nicely reflect, an 
'if and only if’ condition for the stabilizability of the system. That is, stability of 
(/ — P 2 2 A’) -1 can be expressed in terms of the stability of the matrix 



which in turn can be expressed in terms of the above factorizations (for a nice derivation 
of this connection, see section 6.4.2 of [63]). 

4. A similar theorem can be established using coprime factorizations of P 22 and Kq. 

5. If T(T, Q) is minimized over Q then this problem is equivalent to the model matching 
problem (match Ty 2 QT 2 \ as close to the mo del T tl as possible). 

6. Under various assumptions on T tJ this problem represents the so called 1-block, 2-block 
or 4-block problem. 

7. Under certain assumptions on T u the problem can be transformed into the Hankel 
Approximation Problem (also called Nehari Extension Problem). 

S. As Q is restricted to be stable and proper, this represents an infinite dimensional opti- 
mization problem. Boyd ([1]) used the above parametrization in Q with a prespecified 
order (large!) to approximate this problem. 

9. For a nice introduction into //. x see [22], [63] or [57] and tor a thorough mathematical 
treatment of this problem, see e.g. [61]. 

3.4 State-Space Formulae for the iT^-Bound Problem 

Instead of dwelling into the mathematics involved in the solution of the most general case (i.e. 
the 4-block problem), we will summarize key results that give precise state-space formulae for 
which the //, x — bound problem can be solved. One of the important results is that all strictly 
proper stabilizing controllers have the state-space realization of an observer. This fact can 
be shown using state-space realization of the coprime factors defined above and assembling a 
complete realization of the controller A (s). This structural knowledge has been exploited by 
Doyle, Glover, Khargonekar, Francis yielding the well-known DGKF-method (see [13], [63]). 
At this point two different approaches have been considered; one relies on two algebraic 
Riccati equations and a coupling condition (as pursued by Doyle, Glover, Khargonekar., 
Francis) which form the basis for most solution of the bound problem. A summary 

of this approach can be found in the 1988 paper of Glover and Doyle [16]. The proof to 
this approach relies heavily on factorization me tho ds, but it also has a nice interpretation in 
terms of the Youla parametrization and game theoretical results. The other approach taken 
by Khargonekar and Zhou [21] as well as Sampei and Nakamichi [46] is based on two Riccati 
inequalities. 
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3.4.1 The DGKF Results 

Let us first consider the standard assumptions and state the problem formulation of the 
DGKF paper [13]. The system under consideration has the state-space realization given for 
the system £ (see (42)) with w(t) € R mi , u{t) € R mi , ~(D € R p ' , y{t) G R p \ x{t) 6 R n ■ 
With the following additional assumptions (often termed the standard tfoo-assu mptions): 

• Al. ( A,B 2 ) controllable and (C 2 ,A) stabilizable 


• A2. rank(Z9i 2 ) = m 2 i rank(D 2 i) — p 2 

• A3. D n = ^ j' 

D n = ( 0 / ). 

n _ { Dun Duu \ 

11 " ^ D iin Du22 ) 

where Dm 2 has m 2 rows and p 2 columns 

• A4. D 22 = 0 

• A5. rank ^ 1 ^ j = n + m 2 € R 

• A6. rank ( p* ^ = n + Pi Vu? € 

Remarks: 

• Assumption Al is required to stabilize a possibly unstable plant P\ equivalently this 
is necessary tor the existence ot a stabilizing controller. 

• Assumption A2 is a sufficient condition for the existence of a proper controller. 

• Assumption A3 can always be achieved by a preliminary scaling and a unitary trans- 
formation as long as A'2 is satisfied. 

• Assumption A4 D 22 ^ 0 can be reincorporated into the controller alter that controller 
is designed for D 22 — 0. An alternative route to this ieincoipoiation is gicen bv 
yet another preliminary unitary transformation as suggested by Stoorvogel [66] that 

results in a system with D n - 0. 

1 

i 


m 


t 


20 


• Assumptions A5 and A 6 require that the transfer functions from u to z and from w to y 
have no invariant zeros on the jo;— axis. One interpretation of these conditions can be 
traced back to the Youla parametrization (see e.g. [17]): T 2X (T x2 respectively) is right 
(left respectively) invertible in RLoc iff Ao (A 6 respectively) is satisfied. This means 
that this approach can be converted into a Nehari extension problem. Another (state- 
space) interpretation for these requirements is given by the fact that the two ARE s to 
be defined have a solution if the associated Hamiltonian has no ^’-eigenvalues which 
in turn is given only if A5 and A 6 are satisfied. 

With the above assumptions, the existence theorem can be clearly stated. 

Let’s define 

d,. = (b„ d 12 ). d., = (£;;) 

S-dJId,. °). R = C..B5 - ( ’o" o 

B=(B, B,). C=(%). 

Finally let p{.) denote tin 1 spectral radius (maximum eigenvalue) of its argument, then 

Theorem 3.3 ([13], [16], [63]) Consider a system X as defined above with the assump- 
tions A l - A6 satisfied, then there exists an internal stabilizing controller R(s) such that 

\\IF(P, A )||oo < 7 if and only if 

1. 7 > max{a[D uu , D IU2 \,(t[DJ iu . Dj m }}_ 

2. there is a real solution A, x , = A , x > 0 to the ARE 

XX A - BR~ l DjX'i) + M - BR-'DjXifXoo 
-X.^BR-'B t Xk, + cj\l- D u R-'Dl)C\ = 0 (55) 

3. there is a real solution = \ fi > 0 to the ARE 

YXA - B i D*R- l C) T + (A - B^R-'OYn 
-Y^C t R-'CY^ + BfiJ - Df x R~ l D, x )BJ = 0 (56) 

4- P( A'ooV*>) < 7 2 - 

A state-space realization for the controller is given in the references cited with this theorem. 

Let us turn to some interpretations: 

1 . The ARE (55) is frequently called the Generalized Control Algebraic Riccati Equation 
(GCA RE) as A lX , is necessary for the existence of a state feedback controller and thus 
the existence of the feedback gain matrix from the controller to the plant. The ARE 
(56) on the other hand is frequently called the Generalized Filter Algebraic Riccati 
Equation (GFARE) as V’*, is necessary for the existence of an observer-based controller 
in the case of output feedback which then involves an estimation (Luenberger observer) 
to reconstruct the states that are not directly available from y. Condition 4 finally 
reflects the H lX ,- bound (see [17]). 
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2. If A3 is not satisfied, this scheme breaks down; this problem is called the singular H 
problem which has been tackled by Stoorvogel in his dissertation ([66]). 

3. The derived controller is not unique despite the fact that A,*, and Too are unique. 
The ‘standard’ realization of the controller given in literature is one of many if such a 
controller exists. If, however, one of the above conditions is violated then there is no 
stabilizing controller that achieves the //.*,- bound. This is the most significant result 
of this formulation. 

4. Also, if a controller is designed using this method for a prespecifiecl 7, nothing can be 
said about what the actual H ,^- norm of the closed loop system is, only that the bound 
is satisfied. 

5. The proof relies heavily on frequency domain factorization ideas, a complete proof can 
be found in [17]. 

6. The design procedure depends on whether only a //.^-bound solution is desired or if 
the 77, x .-norm of the closed loop system is actually to be minimized. In the first case, 
only the stated conditions have to checked for a. given 7. In the latter case we have to 
iterate on 7 with decreasing values ol 7 until one ot the above conditions is violated. 

7. The controller order is that of the plant so that possible frequency weighting will 
increase the order of the controller (i.e. plant order plus the sum ol the order ol all the 
frequency weights!). 

3 .4.2 The Zhou and Khargonekar Results 

As mentioned earlier, the authors examined the H ^- bound problem using the Quadratic 
Matrix Inequality (17). Their approach is appealing since it does not impose as many re- 
strictions as the DGKF algorithm. Also, the proof uses mostly algebraic methods and is 
easier to follow. However, the design procedure involves another tuning parameter in addi- 
tion to 7. The presentation here mainly follows the paper by Sampai, Mita and Nakamichi 
[46]. Their results in [46] are an extension of the results in [21] where the state feedback case 
is treated. Let us look at the assumptions made in this approach. 

The system under consideration is the state-space realization of the system S (see (42)) with 
w (t) G R m \ u(t) <E R ={t) G R Pl , y[t) € R p \ x(t) G R n and the additional assumptions: 

A1 (.4, B 2 ) controllable and ( C 2 , .4 ) observable 

A 2 Du ~ 0 

These are the only restrictions on the system model. .41 has already been justified and A2 has 
already been identified as not being restrictive at all. Clearly this approach can accommodate 
a far wider class of problems where only observability and controllability of the above stated 
matrices have to be satisfied; these are standard assumption in any traditional LQ-design. 
The approach is split into two categories: development of necessary and sufficient conditions 



for the strictly proper controller case and its extension to the proper case. 

Some results are summarized below. For the state feedback case Khargonekar and Zhou 
[21] showed when C 2 = /, D 2 , - 0 and D 22 = 0 - the state-feedback configuration - the 
optimal state feedback gain matrix F can be characterized in terms of a certain ARE (eqn. 
3.3 in [21]). Theorem 3.5 in this reference finally presents a state-space realization of the 
state- feedback gain matrix F that achieves the desired H^- bound. W ith the above results, 
the main theorem of [46] can be stated as follows, where G c denotes the closed-loop system 
transfer function matrix between w and r. 

Theorem 3.4 ([46], Theorem 1, Corollary 1) Denote R = {j 2 ~Dj x D u ) and S = (y 2 - 
D u Dj y ). There is a strictly proper controller which stabilizes the system under consideration 
and satisfies ||G C ||. X . < 7 if and only if the following conditions are satisfied: 

1. R > 0 

2. There exists a P = P T > 0 and a Q = Q T > 0 satisfying the following conditions: 

a) There exists a matrix F such that 

P[A + B 2 F + B x R~ l Dj x {C x + D v2 F)\ + [A+ B 2 F + B x R- x D t u {C\ + D v 2 F)} t P 
+ PB x R~ x B t x P + (C, + D X2 F) T {[ + D lx R- l Dj x )(C l + D x2 F) t < 0 (57) 

b) There exists a matrix A such that 

Q[.4 + KC 2 + Cj D xl {B x + KD 2X ) t ) + [A + I\C 2 + Cf S~ l D XX {B X + A D n ) T \ l Q 
+{B X + KD ix ){I + Dj x S~' D XX )(B X I KD 2l ) T < 0 (58) 

c) p{QP) < 7 2 

[f such matrices exist, then a parametrization of a strictly proper controller is given by 

ao = Am + B y (t) 
u[t) = cajj 

where the matrices A, B and C are defined by equations (8}-(T2) in Corollary I of [46]. 

The extension to the proper case is performed by finding a matrix D , the high frequency 
gain of the proper controller, that maintains the H^- bound property of the strictly proper 
controller designed for the system. Theorem 2 and Algorithm 1 in [46] give necessary and 
sufficient conditions for the existence of such a proper controller as well as a parametrization 
and a computational 'guideline’ for the actual computation of the controller. The matrices 
F and K in above theorem can be computed using Zhou and Khargonekar s proceduie in 
[21]. This computation involves the additional tuning parameter mentioned above. 
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4 Current Approaches in Mixed Ho/H ^- Control 

As mentioned in the introduction, the // lX> - framework only provides robust stability. Ro- 
bust performance can be incorporated by introducing a 'fictitious* performance A-blocks 
or frequency weighting. System inputs and outputs that are associated with system uncer- 
tainties and other noises entering the system cannot be modeled independently in a pure 
// x - framework. If mixed strategies are desired, i.e. a // 2 -criterion for some criterion outputs 
z 2 with respect to some disturbance inputs io 2 and at the same time a //^-criterion for some 
; lX ,with respect to some w.^ , then we arrive at the problem of mixed H 2 jH oii -c ontrol. The 
structural setup for this problem has to be extended to include the new inputs and outputs. 
The most general description of this problem can be put in the following form: 

.i •(/,) - Ax{t) + BiWi(t) + B 2 w <x ,{t) + B 3 u{t.) 

z 2 (t) •= &\x(t) + D u w 2 {t) + + D l 3 u{t) 

2/yz, ' < Zozit) = C 2 .r{t) + D 2 iw 2 {t) + D22~ w oc{t) + D 23 u{t) 

„ y{t) = C 3 x{t) + DziWiit) + D 32 w. x \t) + £> 33«(0 

Note, that this system description is very general, it can include external disturbances enter- 
ing the system (modeled by w 2 ) , disturbances due to system uncertainties (modeled by ) , 

an output vector representing the output for the feedback closure via the uncertainty 
system A(s) and an output vector : 2 representing a set of signals to which the /^-objective 
is applied. It is obvious that this kind of system assumptions allows a more realistic system 
model than that assumed for pure // x problems. A feedback controller I\(s) is given by 
u{s) = K{s)y{s). Design objectives are then expressed in terms of a //^-criterion from 
Wtx, to for robust stability and an /^-objective for the transfer function from w 2 to z 2 . 
These design objectives, however, do not take into account cross-couplings from w 2 to 
and from ie x . to ~ 2 . Due to these cross-couplings a general mixed H 2 j // x -strategy has yet 
to be defined. 

At this point, different design approaches have to be considered separately. They vary in 
basic system assumptions and theoretical strategy. However, connections have been made 
recently and they are stated below. In particular, two important subproblems have been 
investigated recently, namely the two 'disturbance input/one criterion output’ case and the 
'one disturbance input/two criterion output’ case. 

In the following subsections, we adopt the notation of the according reference for ease of 
comparison. Thus, matrices in these subsections might have a different meaning than those 
defined in other sections. Furthermore the explicit time dependency of signals is suppressed 
in most formula. If variables are considered in the frequency- domain, they will be shown 
explicitly. 

4.1 The Bernstein and Haddad Approach 

Researchers Bernstein and Haddad addressed one of the subproblems stated above ([4], [5], 
[9]). Note that an early paper [4] addressed a slightly different problem than the later papers, 
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i.e. the direct feedthrough matrix £ <x , from w to was assumed to be zero in [4]. The 
idea however is the same as in their later papers, which are only an extension to the case 
of a proper transfer function between w and with more complicated Riccati equations). 
To facilitate this presentation, let us consider the case of a strictly proper transfer function 
between w and ~ x , as assumed in [4]. The system under consideration is' 


V BH 

^2/cc 


x — .4 x + D\w T Bit 

z 2 — E\X 4- E 2 u 

2oo = El. x X + E 2 ,yzU 

, y = Cx + D 2 u' 


(60) 


with a strictly proper controller C(s) of the same order as the plant and it is defined as 


f i c = Ac x c + B c y 

\ U = C c X 


(61) 


along with the following assumptions and notation, 


1 ) (.4, B) and (.4, D \ ) are controllable; 

2) (C, .4) and .4) are observable; 


3) EjE 2 = 0; Ef El = R u Ej E 2 = R 2 > 0; 

4 ) El^Eioo = 0 ; £L£W - R lx ; Ej^E 2 x = R 2 , x : 

5) DiD? = 0\ D x Df = Vi; D 2 Dj = V 2 > 0; 


6) V = 


Vi 0 
0 B V 2 Bj 


R, 


Rix, 0 

0 CjRiooCc 


:R 


Ri 0 
0 CjR 2 C c 


This approach is very appealing as it deals with one disturbance input vector w plays a dual 
role depending on which output vector and, thus, which ^design objective is considered. 


Let the closed-loop system - with the control ler in place - be written in the following form, 

i- = Ti - + Dw (62) 

~ 2 = Ex (63) 

r x = (64) 

where x contains the plant and controller states, the above state model matrices can easily 
be computed from (60) and (61). Let furthermore the closed-loop transfer function from w 
to Coc be denoted by H[.s), 

H{s) = E.^{sl - A)~ l b (65) 

then the design objectives can be stated as follows, 

i) Find a strictly proper controller such that the closed-loop system from w to z x is 
asymptotically stable, and 
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ii) the closed-loop transfer function between w and satisfies 

P(a)IU<7 ( 66 ) 

where 7 is a prespecified constant, and 

iii) the controller minimizes the cost function 

J{A C , B c .C c ) = Hm £{x t E t Ex] 

= lim £[x T Rx] (67) 

t — r OCj 


Remarks: 

• For the design objective ii) the disturbance is assumed to be w 6 £ 2 - 

• In iii) it is assumed that w is white gaussian noise with unit spectral density. 

• In iii) £ denotes the expectation operator. 

The solution approach relies on the formulation of an auxiliary problem for the // 2 -pioblem 
that ‘automatically’ enforces the /^-constraint. in (66). To do that let us examine the cost 
function .J(A C , B c .C' c ) in more details. It represents simply a weighted steady-state state 
covariance responses of the closed-loop system to the disturbances w being white noises and 
having a unit power spectral density matrix. It follows from a standaicl lesult that 

J(A C < B c ,C c ) = Trace {QR} (68) 

where Q is the positive definite solution of the Lyapunov equation 

AQ + QA t + V = 0 (69) 

where .4 is asymptotically stable. Now we define the following Riccati equation 

AQ + QA T + 7 ~ 2 QRooQ + V' = 0 (70) 

It can be verified that, if a solution Q for the ARE in (70) exists - assuming the associated 
.4 is asymptotically stable and the above controllability assumption -, then this implies 
\\H(s)\\ x , < 7 and <2 - Q > 0 (Lemma 2.1 in [4]). These results motivate the definition of a 
new cost function that incorporates the H ,^- bound into the i? 2 ' 0 Pti m i za 4i° n - This new cost 
function defined by Bernstein and Haddad is defined in terms of ^2 instead of Q. Namely, 

J(A c ,B c X'c,Q) = Trace {QR} (71) 

It can be easily verified that 

J(A C , B c , C c , Q) > J{A C , B c , C c ) (72) 

From Q — Q > 0 it is obvious that the new cost function represents an upper limit for 
the 2-norm of the closed-loop system so that the whole setup considered by Bernstein and 
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Haddad is suboptimal with respect to the 2-norm minimization as well as in the H ,^- sense 
(since only a bound for the norm ||.//(s)|| 0 o is considered). 

The new auxiliary problem can now be described as ‘‘Minimize the new cost function 
J{A C , B c ,C c , Q) subject to (70)”. 

The further development is based on forming the Lagrangian function for the auxiliary 
optimization problem by appending the ARE (70) to the cost function J(A c ,B c ,C c ,Q). 
This yields 

C{ A c . B c , C c . Q . M ) = Trace {QR + [AQ + QA + y 2 QR^Q + V] M } (73) 

Derivation of this Lagrangian with respect to Q, A c , B c ,C c and M yields the final result. 
The lemma stated below is taken from [56] and its implications will be discussed later. 


Lemma 4.1 ([56], Lemma 1) Let’s consider a plant given by (61) and the according as- 
sumptions stated above. Let 7 be a prespecified positive constant. Furthermore, let C(s) be 
a strictly proper stabilizing controller of the same order as the plant that minimizes the cost 
function J(A C . B c . C c . Q) subject to ||//(.s)|j, x , < 7. Then such a controller exists if and only 
if there exist real symmetric matrices Q > 0. P > 0 and Q > 0 satisfying: 


0 = 
0 = 
0 = 

A c - 
B c = 

0 = 

Q = 


Remarks: 


AQ + QA T + Q [ 7 2 7?i x — Cn 2 'C]Q 
[A + 7 ~ 2 {Q — Q)7?ix,] 7 P + P[A + 7 ~ 2 {Q — Q)-^i«] + Ej Ei 
[A + 7 r'QRi*, + BC c ]Q + Q[A + 7 r 2 QR x « + BC c ) T 
+ 7 - 2 Q[Ruo + CJR 2 ,»C c ]Q + QC t V{'CQ 
.1 — B c C + BC'c + 7 2 QRi-x. 

QC T Vf x 

R 2 C c + B T P + -r 2 R 2 *,C c QP 

( Q + Q Q \ 

{ Q Q ) 


(74) 

CjR 2 C c (75) 

(76) 

(77) 

(78) 

(79) 

( 80 ) 


1. Note that in the original paper of Bernstein and Haddad ([4]) these conditions were 
labeled ‘necessary’. In a very recent paper by Yeh, Banda and Chang ([56]), it has 
been shown that these conditions are also sufficient (see Corollary 1.1 and Theorem 2 
in [56]). This justifies the if and only if relation in above lemma. 

2. The above theory has also been exte nded to the low-order strictly proper controller 
case which adds yet another Lyapunov-type function to the above conditions. This 
additional function is also coupled with the other equations (see Theorem 6.1 in [4]). 

3. Presently only numerical methods are available to solve the system of equations of 
Lemma 4.1 (see e.g. [10] or [11]) - under the assumption that such a solution exists. 


27 


4.2 The Doyle, Zhou and Bodenheimer Approach 

Researchers Doyle, Zhou and Bodenheimer have considered the dual problem to that of 
Bernstein and Haddad ([14], [15]). The problem is dual with respect to the system assump- 
tions as well as the necessary and sufficient conditions derived for their problem. The system 
under consideration is 


V DZB . 

^2/x. • 


X 


y 


Ax + B 0 wq + B\ w\ + E$2 u 

C \ X + D\2 u 

C 2 X *f /^20'^Q + D2\W\ 


(81) 


with a strictly proper full-order controller K{s) 


K(s) 


i- c — Af c x c Ly 

U — -^00 ^ c 


(82) 


Analysis of a System with Two Disturbance Inputs 

In this presentation, only an outline of the approach and some of the lmpoitant con- 
clusions are described. Necessary and sufficient conditions can be derived using Bernstein 
and Haddad s results. Let Go denote the transfer function from lcq to z and Gi the tiansfer 
function from w x to r. The cost function is now defined by the output power ||^||p: 

j - sup ihiip ( 83 ) 

wq^zBS 

Note that the white noise input w 0 constitutes the worst-case disturbance tor signals with 
bounded spectrum, despite the fact that it is not in BV and hence not in 5 as it does not 
have bounded power. However, the authors of this paper assume that the results derived 
exist in the limit for signals in BS — ► white noise. Formally they do treat white noise as 
a set member of BS and assume white noise with unity spectral density S WQW0 1 as the 
worst-case disturbance lor icq. 

Let us at this point assume that a certain controller is in place so that the closed-loop 
system can be written as 

x — .4i + BqWq + B\W\ 

z = Cx + D\iv x (84) 

where i’ contains x and <f c . To illustrate the schematics, we make the assumption D\ 0 
(Note that the proper case is treated in [15] and involves a more complicated set of Riccati 
equations). Then the closed-loop transfer function from w\ to r is simply given by Gi (<s) — 
C(sl - A)~ l B x . Under this additional assumption, the following theorem can be verified. 

Theorem 4.1 ([14], Theorem 1 and Theorem 2) Suppose 7 > HGJoo, then 

sup [\\z\\p - 7 2 IK III] = Trace[B%XiB 0 ] - |K - i~ 2 BjX 1 x\\ 2 p 

sup [ll-lll -7 2 |KIIp] = r ract[Bl X..B 0 ] 

w\€BT,woeBS 


(85) 

( 86 ) 
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with to i lU .'orst = l~ 2 Bi X- t x and AY, is the real symmetric positive definite solution of 

A T X-y + A,.4 + r 2 X r B } BjX., + C T C = 0 (87) 

such that {A -y~ 2 Bj A'-,) is asymptotically stable and the parameter 7 has to be chosen large 
enough so that || tr 1 ||p = ||7 -2 Bi A-,i:||p < 1 . 

Note that the last assumption assures w\ E BV . Furthermore the factorization uq — h i 
can be motivated again. The actual cost J as defined in ( 83 ) can be computed using the ob- 
servability grammian or the controllability grammian of the closed-loop system with u>i«, 0 rst 
in place. 


Synthesis in a System with Two Disturbance Inputs 

With these considerations the actual problem statement - the synthesis problem - as ap- 
proached by Doyle, Zhou and Bodenheimer can be stated as 

Given a plant and a prespecified 7, find an internally stabilizing controller h(s) that 

solves the mixed Hi ! //^.-control problem: 

min sup [|[z ||/> - 7 2 || u -’i ||p] 

A'(.?) Wiev,woeBS 


It. is obvious that if we restrict ||»7]|p : 1, then this cost function actually solves the problem 


■J DZB = ipf SU P Ik U p 
^ ( 5 ) wo € BS ,u r 1 € BV 


( 89 ) 


Note that the supremum in the above problem statement is defined over w x € V and not 
over w x E BV as this would involve an ’7 -iteration’ to force 117 into BV. As long as the 
closed-loop system is stable, uq will always be in P. The optimal mixed H 2 j //^-controller is 
defined for a 7 that yields W\ £ BV. It has to be kept in mind that the truly optimal mixed 
l [ 2 j II ^-synthesis problem is defined for ||u7j|p = I . It is clear from the cost function </dzb 
that, for arbitrary 7, Jdzb reduces to the pure i^-norm minimization problem if {<7 = 0, 
and it reduces to the standard norm bound problem if w 0 = 0. 

The actual synthesis of the controller is performed by separating the problem into a so- 
called Mixed Full Control problem and a Mixed Output Estimation problem, corresponding 
respectively to the computation ot an optimal feedback gain matrix and the design of an 
optimal estimator. This procedure will not be covered here as the resulting equations are 
dual to the equations derived by Bernstein and Haddad. 

In the paper [ 56 ] by Yeh, Banda and Chang, it is proved that the two approaches of 
Bernstein/Haddad and" Doyle, Zhou and Bodenheimer yield identical necessary and suffi- 
cient conditions if the Bernstein- Haddad approach is applied to the dual system of £2/00 • 
That is, perform the following change of notation in the above Bernstein- Haddad approach: 


A 


.4 , E x 


B b- 


C 


Bb 


D\ — ► D 2 — > DJ 2 : 
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B 

pr. 
* L 2 » 

E 2 —* Dj 0 ] 

E20C 

A c 

JT. 

c -» l t - 

B c - ~Fl\ 

R 2 

— > 

f?2oc — 1 ■ B-2\ 

V 2 = I (pure scaling) 

and 




Q - 

^ co ; 

Q -» Y\ 

O _» \b 


Then the equations derived from this new dual system by applying Bernstein and Haddad’s 
approach yield exactly the same necessary and sufficient conditions derived by Doyle, Zhou 
and Bodenheimer in [14] so that the actual controller computation is reduced to the same 
coupled equations as derived in [4], This is a very interesting result. The importance of the 
work of Doyle, Zhou and Bodenheimer in this field is in the interpretation and analysis of 
the type of disturbance signals in mixed H 2 /H :Xj - analysis. 


Finally an observation made by Doyle, Zhou and Bodenheimer is that the mixed H 2 j Hoc~ 
control problem is solvable only if the pure /Zoo-control with the chosen 7 is solvable (see 
[15], Lemma 1). This is an important and intuitive result. If there is no controller that 
solves the suboptimal // x - bound problem for the chosen 7 then there will be no mixed 
H,/ f/x,- controller achieving the mixed H 2 / //^-strategy. 


4.3 The Rotea and Khargonekar Results 

4.3.1 A Bernstein-Haddad Equivalent Setup with State and Static Output 
Feedback 


Researchers Rotea and Khargonekar ([18], [25], [26], [27]) addressed two subproblems of the 
above general mixed -problem. The first problem is similar to that of Bernstein and 

Haddad, namely 


iRKl 

'2/x. 


x 

~2 


Ax -f Bi w + Biu 
CqX + DqU 
Cix + D\ u 
C 2 x 1 


(90) 


Their results are important because they provided a controller factorization that results in 
a convex optimization problem for the cases of state feedback or static output feedback. 
The general problem statement that Rotea and Khargonekar addressed can be described as 
follows, 


"For a plant find an output feedback controller u{s) = A ( s)y{s ) such that ||Tj 2U ,||2 < o 

subject to internal stability and ||7b > .. lt ,|| oc < 7.” 


Note that this problem has a slightly different design goal since it tries to satisfy a 2-norm 
bound instead of a minimization of || 7Zr 2 |] 2 - However, the mathematics involved are almost 
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identical to Bernstein and Haddad's approach except for the parametrization of the controller 
K . Note that here the case of 7 = 1 is considered which obviously can always be achieved 
by appropriate scaling. 

Before we examine the more general case of output feedback, let u.s look at the simpler 
problem of state feedback. That is C 2 = /, D 2 = 0 and a state-feedback controller u(s) = 
A (s)y(s). Then the closed-loop system is defined by 

i = (A+ B 2 K)x + B,w (91) 

* 2 = (Co + D 0 I<)x (92) 

coo = (C\ + DiK)x (93) 

Now. following Bernstein and Haddad, the condition ||7V x . u ..|| co < 1 is ensured if a real 
symmetric positive definite solution V exists for the following Riccati equation 

[A + B 2 K]Y + Y[A + B 2 K} t + Y\Ci + D X K] T [C\ + D X K]Y + B r B{ < 0 (94) 

ancl (A + B 2 A ) asymptotically stable. Define an upper bound for the 2-norm from w to z 2 

with the cost function 

J[K) = Trace[(C 0 + D U K)Y{C 0 + D 0 l\) T } > |[T g2tB || 2 = Trace{(C 0 + D 0 K)L c (C 0 + D 0 I<) T \ 

(95) 

So far the results are similar to those of Bernstein and Haddad for the given system. The 
significant, difference is in the controller parametrization. Let 

K = WY~ l (96) 

where W is a set of matrices of appropriate dimensions. Note that the matrix Y is symmetric 
and of dimension n x n. Let x 6 R n . and u £ R q and define the following set 

n -.= {(ir,r) e R«* n xQ : r > 0} 

where 0 is the set of nxn symmetric matrices . If we put this controller into the cost function 
(95) and the corresponding Riccati equation (94), then the following functions can be defined 

f(W,Y) = 7Ya.ce[(Co+ D 0 WY~ l )Y(C 0 + D 0 WY~ l ) T ] (97) 

Q(W, Y) = ,4V + ) A t + B 2 W + W T B 2 + B x B{ + (C,V + D X W) T {C\Y + DiW\9 8) 

We can now define the new optimization problem as 

"Find K such that, inf /(IF, Y) < a subject to Q(W,Y) < 0 with (IT, V) € Y. ' 

Next we cite some properties of this optimization problem which have been proven in [27]: 

1. f(W-,Y) is a real analytic convex function on fl, this is the major contribution of this 
factorization. 

2. Q(W,Y) is a convex matrix valued mapping from fl — > 0 if Y is positive definite. 

3. The set {(IF,}') 6 ft : Q(IF, Y) < 0} is bounded if D, has full column rank 

and (Ci,— .4) is detectable, where C'i = (/ — D x (Dj D X )~ X and A — A — 

B 2 (DlDi)-'DjCi. 
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4. Under these additional conditions the new optimization problem is a finite dimensional 
convex optimization problem on a bounded domain, a very nice property. 

The problem of a static output feedback design in the general system as posed in E^, 1 
can be solved by defining an auxiliary system that has a ‘state feedback form as a function 
of a Riccati equation which in turn depends on the chosen 7. In this manner, the static 
output feedback case is reduced to the state feedback case. 


4 .3.2 A System with Two Inputs and Two Outputs 

The more general problem of ‘simultaneous’ control ([26]) involving a system with 

two disturbance inputs and two criterion outputs has been considered. It is given as follows 


( x 


V RK2 . 

2j 2/.x • 


~2 


1 y 


Ax -f- B 1 f ['2 T B 2 u\ x 4 B 3 u 

C\X -j- D\U 
C 2 x + Dj u 
x 


(99) 


It can be seen that tins approach is also restricted to the state feedback case. Let ?? denote 
the dimension of the above system. Let T 2 denote the transfer function between W 2 and 
and T 0 c . the transfer function between ic x a 11 (1 c, Xl . At this point it should be mentioned 
that all the previous at tempts to solve the mixed H 2 / H ^- problem are set up as constrained 
optimization problems. That is: "Find a controller that minimizes ||T 2 || 2 and ||T x ,|| C o < 7”- 
The approach taken in this work is of a different nature. 

"The controller to be found is admissible if it minimizes 1 1 uU 2 1 1 2 such that the ||T X ,||, X , < 1 . 
The latter formulation represents an unconstrained optimization problem. The approach uti- 
lizes a characterization of all dynamic state feedback controllers that minimize !|T 2 || 2 . Among 
these controllers then the ones that satisfy the additional //^-constraint are selected. The 
basis for their analysis is the fact that the controller that minimizes j] T2 II2 ' s n °l necessaiily 
unique. Let us look at the assumptions in their approach first. 


Al: (.4, B 3 ) is stabiiizable, 

A2: D x and D 2 have full column rank, 

A3: The transfer functions from u to z 2 and from u to have no invariant zeios on the 
imaginary axis, 


A4: Dl\C 2 D 2 ] = [0 /]. 

These are standard assumptions to ensure that an optimal LQ-state feedback controller 
exists. Let's (,) + denote the Moore Penrose inverse, i.e. X X + A = A and A + A.\ + = A + 
and define the following matrices and Riccati equation 


= .4 


A> + X f A - (DfC x + BlX F ) T {D T x D l )- x {D T l C x + Bj X F ) + C J C x (100) 


= -[D]Dx)-\D t x Cx + bJx f ) 


( 101 ) 


0 

F 


32 


III 


( 102 ) 

Af 

= a + b 3 f 

(103) 

C\F 

= c, + /;,/•• 

(104) 

Gif 

= c 2 + d 2 f 

(105) 

where Xp 
minimizes 

is the unique solution of ARE (100) and 
||7 2 || 2 . However, this is only one possible : 

F is the state feedback matrix that 
solution if B i is not of full row rank. 


The class of all minimizing controllers K(s) can be characterized in terms of 2 transfer 


function matrices. For that purpose we define the set S of transfer functions as 

5 = {Qe RH„ : Q = WUfisI - Af), W € RH 2 }. (106) 

Then Rotea and Khargonekar have shown in Theorem 1 of [25] that the class of all 
dynamic state feedback controllers that minimize || H 2 is given by 

■i[< = Apx k + B^r 

u = Fy + Jr 

c = -Ix K + Iy (107) 

r = Qv 

Q e S 

The proof for this theorem consists of first using the Youla parametrization to show that 
the defined class of controllers is actually stabilizing the plant and then this parametrization 
is used to show that Q £ S is the class of controllers that minimizes (JTa || 2 - It is easily 
verified now that if im{B \ ) = R" then FT 1 — 0 and the above class of minimizing controllers 
reduces to the minimizing static feedback 'controller’ F (im(.) denotes the image space. of 
the argument). In this case, this design method will result in F as the optimal state feedback 
matrix. The condition of whether or not ||T’ x ,|| oc . < 7 is satisfied, has to be checked via the 
according Riccati equation or the respective hamiltonian. On the other hand. If tm{B\) is 
a. proper subspace of R n then the freedom given by the family of controllers in (107) can 
be used to satisfy the additional H&- requirement. The following theorem characterizes the 
class of all dynamic state feedback controllers that satisfy the //^.-requirement in addition. 

Theorem 4.2 (Theorem 2 in [25]) Given a system as defined above, the problem 

of minimizing ]| |]2 such that ||7’ x ,||, x , < 1 is solvable if and only if the following conditions 
are satisfied: 

1. The ARE 

A T X^, + A 2x ,.4 + X 2x ,( B 2 Bj - B Z B\ )X 2x , + CjC 2 = 0 (108) 

has a stabilizing positive, semi-definite solution A 200 , 

2. The ARE 

^ 2co ^F + ^ 2^C2fC’2F^2oo + B 2 (I — V- 2 + \ 2 )B 2 = 0 

has a stabilizing solution 



(109) 
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3 . 


2co-^2oo) < 1- 


( 110 ) 


where V 2 = FI 1 5 2 . 

If these conditions are satisfied then the class of all optimal H 2 / B^-optunnl dynamic state 
feedback controllers - optimal in the sense as defined above - is given by 

K 2co (s) :=(.4 2x , £ 2 ' x \C 2o °, £> 2o °). 

where 

>l 2co = ,4 -f- {I — Q)BzH + QB 3 F + (/ — 0 ) 5 - 2-62 A- 2 cc 

B** = 4 2x 0 - 0,l F 

C 2co = H - F 

D 2 *' = F{I - 0) + 60 

0 = z 2 b 2 v+ n , 

H = -5j.V 2x 

Za = (/-ncc^cc )' 1 

Remarks: 

1. The setup considers the ’nonsingular case, that is DjD 1 ^ 0. 

2. Solvability of ARE (LOS) ensures that ||T M |U < 1 (see [13], Theorem 2). 

3. ARE (109) and equation (110) represent conditions that ensure the existence of a 
controller that solves the problem of minimizing ||T 2 || 2 . 

4. Note that V 2 = U 1 B 2 = {I-B ] B+)B 2 . Thus V 2 = 0 and V 2 + = 0 if either im(B x ) € R n 
or im( B 2 ) C im( 6, ). In both cases, the optimal controller K 2 '~(s) reduces to the static 
state feedback controller K 2,x, (s) = F. 

5. A design algorithm has to solve ARE (100) to find F , then Theorem 4.2 can be applied 
to find the optimal mixed H 2 /H (X , -controller. 

6. This approach only considers the case of static or dynamic state feedback. 

4.4 Other Approaches in Mixed H-ij H t ^-Control 

4.4.1 Mustafa’s Entropy Function 

Before we present our design approach to the mixed H 2 / H. x - control problem, the so-called 
entropy (at infinity, see [64]) ol a system needs to be defined. 
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Definition 4.1 (Definition 2.2.1 in [64], see also [57]) Consider 

a system H:=(A,B,C,D) with H £ RL X , if ||//'|| 0O < 7 then the 7- entropy of this system 
(at infinity) I(H, 7) is defined as 

I(H, 7) = ~ In | det{I - 1 - 2 H'(ju,')H(juj)} | dio (111) 

Z7T J — cc 

if l|ff||~ > 7 then I(H, 7) is unbounded (infinite). Thus, the entropy of the considered 
system is finite if and only if the chosen 7 is larger then |[#||oo- This fact establishes the 
connection of entropy to the H^, -framework. Connection to H 2 can be established using 
Lemma A. 2.1 in [64] which states that 

-In | (/ -e 2 N’N) [> s 2 Trace{N'N} 

With the above lemma it can be verified that the entropy of a strictly proper system is an 
upper bound for its 2- norm. That is, (see Theorem 2.4.4 in [64]) let H be strictly proper 
and ||//||oo < 7, then l{Hr,) > \\H\\]. It can further be shown that lirru^^ I(H, 7) = \\H\\l. 
From now on, entropy will denote the entropy at infinity as defined by Mustafa and Glover 
in [64]. It. is obvious that the entropy as defined represents yet another characterization of an 
H 0 o-norm bound. The cost function used for mixed H 2 f H, x , -control finally is (see Definition 
1 in [31]) as follows. 

Definition 4.2 ([31]) Consider a system H(s) = [H 0 (s) #i(s)] with H 0 (s) £ RH 2 , 

H\(s) £ RH C c and || H 1 ||, Xl < 7. then we define 

L(H, 7) = J- r Trace {(I — 7 -2 H X H;)~ X H 0 H'}du (112) 

In their paper [31], MacMartin, Hall and Mustafa have shown that L{H, 7) also represents an 
upper bound for the 2-norm of Ho', namely, L(H, 7) > |[i/o||2 an( ^ hm-,_.>c, L(H, 7) = ||^o ||1- 
Thus, for 7 —* 00 the defined cost function represents a pure H 2 cost function. For a finite 
7, L(H,~j) represents a compromise between an /^-strategy on Ho and and an //.^-strategy 
on H i- The best //^-strategy for ||#i|i.x. < 7 ‘ s obviously achieved if all the singular values 
of H 1 are as small as possible, and thus ||//i|| co is as small as possible. The H 2 -stv&tegy is 
pursued by the fact that L(H, 7) overbounds ]| /To |jl * 

The objective is to minimize this cost functi on fo r a certain 7 assuming that ||#i||co < 7- 
The actual minimization of L{H, 7) is performed using a state-space approach where the 
cost is evaluated in terms of these state-space matrices. The system under consideration is 
identical to d e fi nec l above. H 0 and H x represent the transfer functions from io 0 and w x 

to 5 respectively. The mathematical optimization is performed similar to the approach taken 
by Bernstein and Haddad by appending the // X -ARK to the cost, function via a Lagrange 
multiplier matrix. Derivatives of the resulting Lagrangian with respect to all the respective 
matrices yield the required necessary conditions consisting of two ARE’s and two Lyapunov 
equations that are coupled. Solutions for these coupled equations are also based on numerical 
methods. 
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4.4.2 Steinbuch and Bosgra 

Steinbuch and Bosgra addressed both setups (i.e. two disturbance inputs/ one criterion out- 
put as well as one disturbance input/two criterion outputs) as defined by Bernstein/Haddad 
and Doyle/Zhou / Bodenheimer . For both systems they consider the static output feedback 
case. The first considered system is of the form (81) with a cost function similar to that 
defined in Theorem 4.1. The difference to the Doyle/Zhou/ Bodenheimer approach is the 
explicit assumption that tc, = Kx where x is the system state. This assumption is justified 
by the form of w Xworst as established in Theorem 4.1. The procedure involves once again 
the forming of a Lagrangian and the subsequent derivation of necessary conditions. These 
necessary conditions involve coupled quadratic matrix equations that have to be solved nu- 
merically. A solution for the setup of Bernstein and Haddad follows by duality. The extension 
to fixed order dynamic feedback has also been pointed out. 

An interesting comment, was made at the end of this paper, namely the authors suggested 
that the worst case iT x .-d isturbance can be defined using an observer- based 'disturbance 
generator 1 . 

4.5 Summary 

From the above presentation one can see that all analytical methods currently available aie 
based in one way or another on a set of Riccati (and Lyapunov) equations. Except foi the 
work of Rotea and Khargonekar (the two input/two disturbance case with dynamic state 
feedback compensators), these resulting equations are highly coupled and can be solved only- 
using numerical methods. Also, all the approaches assume white noise as the worst-case 
disturbance for the H 2 - optimal strategy. In many cases, it is desirable to find a controller 
that optimizes the system with respect to different disturbance distributions. This design 
objective has not yet been incorporated into these approaches. 

An important fact can be deduced from these approaches. In the two disturbance in- 
puts/one criterion output' case as well as in the ‘one disturbance input/two criterion outputs 4 
case, the worst-case disturbance for the -strategy can be expressed as a linear combination 
of the system state x. In the more general case of the ‘two disturbance inputs/two criterion 
outputs’ Steinbuch and Bosgra suggested the use of a dynamical system to generate the 
worst-case disturbance. 


5 On the Cost Functional Jo {z T (t)z(t) -7 2 w T (t)w(t)}dt 

The above cost functional is closely related to equation (20). The relation has been estab- 
lished by Craven (see [60] on pages 108-109). A time-domain definition of the H^-norm (in 
equation (20) in terms of a LQ-type function can be done using a Lagrange multiplier u to 
include the constraint ||ui ||2 = 1 into the cost ||?|| 2 - W® have 

\\HWl = sup , |ui(0 | |2=1 + u[w T (t)w(t) - \}}dt 

The constraint || tt;(f ) [| 2 = 1 is achieved in an iterative manner. If the problem is to determine 
whether \\H\\, X . < 7 , the function defined in the title of this section is very valuable. Let 
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w(t) denote the input and ~(t) the output of a linear time invariant system. A more recent 
analysis of this cost function has been performed by G. Tadmor ([48], [49] and [50]) and a 
clear connection between inequality (21) and the above cost function has been established. 
Let in this section ||| = fa v T {t)v(t)dt. 

Observation 5.1 Consider a system G:—(A,B,C',D) where .4 /s asymptotically stable, 
.r(0) = .i’o, tj > 0 and w(t) € Lz- Define T :Xo : xq — ► ~(t) and T zw : w(t) — > z(t). 
Then 

(113) 

(114) 

(115) 


The chain of inequalities can be verified using the norm-triangular inequality and inequality 
(21). Now it is important to differ between the cases .r(0) = .i'o 0 and .r(0) = 0. For 
,r(0) = 0 we recover the inequality (21.) When .r(0) = xq f- 0 additional terms based on the 
system response to these initial conditions have to be considered. In general the following 
can be stated. 

Observation 5.2 ([49]) Consider a system G:=(A,B,C,D) where .4 is asymptotically 
stable , .r(0) = .r„, tj -> 00 and «•(/) € I 3 . then j|<7||o* < A iff there is a 6{x 0 .w) > 0 such 
that 

ll-lli - ~t 2 \\ W \\l < tC ) ||i.C H2 ( 116 ) 

Note that the above inequalities are valid for any Xq and any w[t) including the worst-case 
disturbance w wor »t[t) in L-z- To append one o f t hese inequalities with w(i) eu wors t{t ) (by 

taking max ot both sides) as a side constraint to an //^-optimization problem the paiametei 
5{x o, w) has to be known beforehand. 6{xq.w) is not known apriori as it is a function of 
the disturbance ic[t) and ip . File defined fu nct ion is still valuable in the //co-sense due to 
properties discussed in the remaining section. To see this let us consider a maximization 
problem for finite time as follows. 

Definition 5.1 Consider the following optimization problem with G:=(A,B,C,D), .4 asymp- 
totically stable, (A,B) controllable, (C.A) observable, x(0) = i’o- tj > 0 and 7 > d{D) 

./,(«?) = max / {z T (t)z(t) — f 2 w T {t)w(t)}dt (11") 

w€Lj Jo 

Note that the condition 7 > 5(D) is a necessary condition for the existence of a maximum. 
Applying standard Lagrange multiplier techniques, the above optimization problem results 
in a Two Point Boundary Problem (TPB\ P): 

Theorem 5.1 Consider the problem defined in Definition 5.1 and for a finite tj. Then the 
worst-case disturbance w 0 (t) is given by 

(US) 


2 - 7 2 |Ml2 = IF-0.ro + T ZW W II2 - 7 2 |Ml 2 

< \\T XX 0 x 0 \ll + \\T, w w\\l-^w\$ 

< HT^o^olli + (II^IlL ~ 1 2 )MI 


W 0 {t) = (7 2 1 - D T D)- l [D T Cx(t) + B T X(t)) 
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subject to 


with boundary conditions 


x{t) 

m 


= M 


x(t) 

m 


x(0) = x 0 

A (tj) = 0 


where 


M = 


(119) 

( 120 ) 
( 121 ) 

( 122 ) 


.4+ BR~'D T C BR~ x B t \ 

— 7 2 C t 5’" 1 C —[,4 + BR~ 1 D t C] t ) ’ 

H — ('., 2 / _ D T D), S = (V 2 / — DD T ) and A (t) being the Lagrange multiplier vector. 

Note that this is an ’open-loop’ characterization of w[t), a closed-loop description of Wo(t) 
can be found in terms of the solution of a differential Riccati equation as follows. 

Theorem 5.2 If a solution for the differential Riccati equation 


2 x (t) + Z x (t)[A + BR- l D T C } + [A + BR- l D T C] T Z l (t) 
+Z l (t)BR- l B T Z x (t) + 7 2 C r 5- , C - 0 


with the boundary condition 
exists, then 
and 


Zi(tj)= 0 
■h — .r o T Zi(0).r o 


(123) 

(124) 

(125) 

(126) 


(127) 


w 0 (t) = ( 7 2 / - D t D)~ 1 [D t C + B r Z x (t)}x(t) 

Equivalent results can be derived for the infinite-time case. We have 

Definition 5.2 

J 2 (uj = max lim / {z T [t)z{t) — j 2 w T (t)w{t)}dt 
ll’€L-2 tf Jo 

with the same assumptions as in definition 5.1 . 

For the infinite time problem as tj — » oo, the differential Riccati equation will reduce to an 
algebraic Riccati equation. 

Theorem 5.3 If a solution for the algebraic Riccati equation 

[A t 4- C T DR~ l B T )Z\ + Z\[A -1- BR~ l D T C] + Z x BR~ l B T Z x + j 2 C' T S~ l C = 0 (12S) 

exists and 

A + S(7 2 / - D t D)- x [D t C + B T Z X ) (129) 

is asymptotically stable , then 

J 2 = xlZ x x o (130) 

and 

wo{t) = (7 2 / — D T D)~ l [D t C + £ T Zi]a. - (£) (131) 
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If a solution of this type exists then the associated TP BYT is also solvable. An important 
observation from this theorem is that the worst-case disturbance for tj — > oc is of a "full 
state feedback type'. That is, ie 0 ( t) = Kx(t) can be motivated. 

Some very interesting connections between the H ,^- norm and the optimization problem 
J 2 are given by the Hamiltonian matrices M 7 (see equation (10)) and .1/-, and the associated 
Riccati equations. It is easy to verify that the following is true. 


Mr, = 7" Tv., 7' 

( 132) 

/ — Cl n Y 


(133) 

V 0 -A 1 ) 


Note that T is nonsingular and has no eigenvalue A; with /?e(A,) = 0 for any 7 > 0. Thus 
we have the following lemma. 

Lemma 5.1 Consider a system G:=(A,B,C,D) with ,4 asymptotically stable, (A.B) control- 
lable, (C,A) observable and 7 > a(D), then the following statements are equivalent: 

2. [AT, nonsingular Vw £ ft, 

3. [AT — jw'/] non singular Vu; £ ft. 

4 . The ARE (13) has a unique real positive definite stabilizing solution A x = A ( , 

5. The ARE (123) has a unique real positive definite stabilizing solution Z\ — Zj = 7 A 1 , 

6 . J 2 > 0. 

The equivalence of these conditions is easily verified using previous lemmas and theorems. 
Note also that AT, has the same eigenvalues as Furthermore, if the ARE (128) has a 
solut ion Z\ as characterized in Lemma 5.1, then this solution is unique and is the only solution 
that results in an asymptotically stable .4 + Bfifif - D T D)~ l [D T C + B T Z x ). Furthermore, 
the matrix Z\ is the maximal solution of the AR E (128). That is, every other solution Z\ of 
(128) satisfies Z\ — Z\ > 0. . 

Assume that there exist solutions, Z\ for the ARE (128) and Z x (t) for the differential 
Riccati equation (123), then the value ol the cost function J\(w) satisfies 

J\ = .rj Zx(0).r o = x%Z\, r 0 - x T (t f )Z x x(tj) (134) 

Thus, it can be verified that the optimal value of J\ is monotonically increasing and Z\ > 
Zi(0). Hence Zi represents an upper bound for J\{w) in the limit as tj — ► oc. With these 
preliminaries the following theorem can be st ate d: 

Theorem 5.4 ([ 53 ], [29]) Consider a system G:=(A,B,C,D) where A is asymptotically 
stable, (A,B) controllable, (C,A) observable, C T D = 0, BD T = 0 and 7 > d{D), then, for 
some x 0 

||G|U <7 « 0 < max lim T {z T {t)z{t ) - (t)w(t)}dt < 00 

W tj-.rx.jQ 


(135) 
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The 'if and ony if' relationship between (IGIU < 7 and the nonnegativity of J 2 has already 
been established in lemma ( 5 . 1 ), thus the only remaining part to be proven is the boundedness 
of J 2 . 

Willems in [53] stated a proof that connects HGUco < 7 and the finiteness of the above cost 
functional directly via the frequency inequality while Magierou [29] showed that the solution 
Z 1 (t) of the differential Riccati equation (123) is monotonically increasing. An alternative 
proof based on the associated Hamiltonian is possible also. Thus, if there is no symmetric 
positive definite solution to the Riccati equation (128), then the solution Z\[t) of (123) and 
thus the value of the cost functional J 2 will grow unbounded for some x 0 . Let us now 
define an alternative form ot the above cost function, namely the cost function J 2 with the 
worst-case disturbance w 0 {t) = (7 2 1 - D T D)~ l [D T C + B T K]x(t) in place where the .matrix 
A is used as a design parameter in the determination of the worst-case distuibance. The 
orthogonality condition finally guarantees, that the worst-case disturbance can be generated 
by K . 

Definition 5.3 Consider a system G:=(A,B.C,D) where A is asymptotically stable, (A , B) 
controllable , (C.TJ observable and 7 > cr(D). He define 


.73(A) = max lim Trace {f e F t ['' : 2 C T S l C —KBR l B A]e dt) 
R tj—oo Jo 

where R and S are defined in equation (122) and 


(136) 


F - A + BR~ l [D T C + B T K] (137) 

Note that J 3 ( A’) is just J 2 {w) with the parametrization of w(t) = ( 7 2 I - D T D)~ l [D T C + 
B T l\)x(t). With the assumption 7 > <~r{D) we assure that R and 5 axe positive definite 
matrices. We now know that, if ||G'||x. < 7 • the unique maximizing A = Z\ is positive 
definite, svmmetric and the closed loop system is asymptotically stable, in this case 0 < 
J 2 (Z\) = J 3 (A) < 00 . If we consider the case d(D) < 7 < ||G’||, X , then the ARE (128) 
indicates that, there is no positive definite Zj that 'stabilizes’ the system (there is no solution 
of ARE (128) at all that results in a stable closed-loop system at all). That is, there is 
no symmetric positive definite A that solves the associated Riccati equation such that F is 
asymptotically stable. If we look at the maximization problem for Jfik) it can be verified 
that for A = si (for some s > 0) > 0 can be achieved. Thus we can conclude 

that J 3 ( A’) > 0 for any maximizing K as long as we assume 7 > d(D). Furthermore, 

for a{D) <7 < \\G\\, X . we know that the maximizing I\ will result in an unbounded cost 
function value J 3 (A) for t. f -» oc. Note, that the cost function J 3 (A) corresponds to an 
initial condition ,r 0 with .r 0 .i'o = /• Such an initial condition does not exist, this assumption 
has its justification from stochastic interpretation in terms of covariance matrices. It can 
be seen that A will attempt to destabilize F by being ‘large’, at the same time A must 

be ‘small’ enough to not excite this ‘destabilized’ mode of F with a negative eigenvalue of 

h 2 C T S~ l C - f\ BR~ l B T f\}. This would lead to a negative unbounded cost function value 
which is not in the interest of a maximizing strategy. We also could use a parametrization 
w Q (t) = Kx(t). With this parametrization of the worst-case disturbance for the bound 
problem we arrive at a cost function -JfiK) similar to J 3 (A ). Namely 


MK) 


max lim 

K q—x 


Trace { f’ t cTt [(C + DK) T (C + DI<) - I< T I<}e Gt dt) 


(13S) 
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where G = A + BK. ^ 

Similar observations can be made about this cost function. For K = 0, J 3 (A') > 0- Thus 
every maximizing K once more will yield a non-negative cost. However, it will be more 
convenient to adopt a parametrization as in (131), as this parametrization will allow us a 
better comparison with Riccati-basecl approaches. 

The additional term /j' [~y 2 w T (t)w(t)]dt in the cost function J 2 { w) plays a similar role as 
the term /o' [^u T [t)u{t)]dt in the LQ-design. As g -> oo, the -cheap’ control case is ap- 
proached in LQ-design while 7 < UGctulloo is equivalent to 'cheap disturbances , meaning 
that the disturbances tc can have unbounded power. The worst-case disturbance w is 
necessarily of bounded power if ||G- U ,||, X < 7 so that this cost function actually represents 
max u; lim (/ _ oc ,/o' ~ T {t):{t)(lt for ||G.- W ||» < 7 if we iterate on 7 to achieve ||wo|| 3 = 1. If the 
solution exists, then furthermore Wq 6 L 2 . 


Example: 

Consider the following system G := (.4. B.C , D j with 



-0.0168 

0.1121 

0.0003 —0.5608 \ 


-0.0243 \ 

1 

-0.0164 

-0.7771 

0.9945 0.0015 

R - 

-0.0634 

A — , 

-0.0417 

—3.6595 

-0.9544 0 

, LJ 

-3.6942 


0 

0 

1.0000 0 j 


0 / 

c= 1 

(OOl 

0 ), 

D = 0, 




then it. is easy to verify that the conditions in theorem 5.4 are satisfied. The co-norm of G 
can be computed to be ||G'||^. = 2.9903. The following plot then shows the value of the cost 
function (136) in Definition 5.3 over the finitejime tj for three different values of 7. It is 
easily seen that, tor 7 < ||G|| X . the plot diverges to large values foi laige t.j and to infinite 
values as tj — > 00, while the cost remains bounded and converges to a steady-state value for 
large tj if 7 is chosen such that 7 > ||G'[|, X . 

The H . x - control problem is in general a mill-max problem. We minimize a cost function 
with respect to the controller parameters while maximizing the cost function with respect 
to the disturbances. To see the connection between this min.-max // x . -control problem and 
the cost function in this section let us look to a game theoretical problem associated -with 
the cost function. To shorten this presentation only the case for infinite t f is considered. For 
finite tj similar results can be developed. For this purpose define a system as follows. 



.-hr + Bw + Tu, .r(0) = xq 
Cx + Dw + 


(139) 


where x[t) represents the state of the system, u[t) the control input and w{t) the distuibance. 
Now a game problem can be formulated as follows. 

Definition 5.4 Consider a system described in (139) with (A , Bj controllable, ( -4 , 1 ) con- 


trollable, (C,A) observable, D - 0, Q T C = 0, > 0 and define 


JA u. w) — min max lim 
«€^2 m.’G L2 t / 


n / ‘ {: T {t)z{t) - -) 2 w T {t)w(t)}dt 
^ Jo 


( 140 ) 


41 


J vs Tf for Different Values of 7 



Figure 1: Worst- Case Design 


Note that the assumption D = 0 is not restrictive, it can be easily removed. This assumption 
is only made to facilitate our presentation (for a complete treatment see [24]). Without the 
assumption D T D > 0 t he problem is a singular game problem. Let us skip here the associated 
Two Point Boundary Problem and examine directly the associated Riccati equation for 
t j — > 00 . 

Theorem 5.5 ([35] [29] [53]) In the limit as tj — > -00 the min-max problem stated in Def- 
inition 5-4 with a plant (139) has a finite solution for some x 0 if and only if the ARE 


zfiA-r(n T nr'n T c] + [A-r(n T n)-'n T cfz 2 -z 2 [r(n T nr'r T -~BB T ]z 2 +c T c = o 

1 (141) 

has a positive semi- definite solution Z 2 such that 


.4 - r(« T f ))- l [n r c + r t z 2 ] + $ bb t z 2 


is asymptotically stable, then the optimal strategies are given as 

= Ku4t) = -(n I 'n)- , in T c + r T z,)x(t) (142) 

ttV(0 = K^[i) = -B T Z,x(t) (143) 

7 


and the value of the game is given by 

tVopt) X 0 Z2 Z 0 ^ 0 


(144) 


Furthermore , in this case w 0 pt{t) € £ 2 - 



42 


The resulting ARE is a so-called game- theoretical ARE, characterized by the sign-indefinite 
term [r(ft T ft) -1 F T - T- BB T ]. The proof is based on the same references as in Theorem 
5.4. Connection between this game theoretical problem and the //.^-control problem has 
been pointed out by - among others - Tadmor in [49]. It. can be verified by comparing ARE 
(141) with the ARE in Theorem 2 of [13]. Let 70 denote the smallest H ,^- norm from w to 
~ in (139) achievable with pure state feedback, that is u(t) — I\ u x(t). Let T ;w denote the 
closed-loop transfer function between w and 5 in (139) with it = I\ u x in place, then 

Theorem 5.6 ([49], [13]) Under the assumptions made in [IS] and > 0, there exists 
a state feedback control u(t) = I\ u x{t) such that 7 > 70 (that is min/ Xu ||T'; U ,||, >C , = 70 < 
7 ) if and only if the ARE (l ft) has a symmetric positive definite solution Z 2 such that 
.4 — r(n T Q)-'[n T C + Y T Z 2 ) + ^BB T Z 2 is asymptotically stable. 

Thus, a finite value of the above game, and hence with J 4 (u,w) being bounded implies 
that there is a state feedback matrix that stabilizes the system and achieves [|7 1 - U ,||, X) < 7. 
Furthermore, the worst-case disturbance can be of the form w opt (t) = I\x(t.). If we consider 
static state feedback controllers, then ./,(</. w) being unbounded for a chosen 7 implies that 
there is no state feedback matrix that achieves the bound |[T ;u .||. x . < 7. This, in turn, 
implies 7 < 7 0 . If a general compensator structure is used, then unboundedness of Jfiu. w) 
implies that the given controller cannot satisfy the bound ||7’ ;u ,||. >; , < 7. It is obvious now 
that, the cost, functional considered in this section represents a useful tool to incorporate an 
//^-constraint into a H 2 - cost function. 


6 A LQ-Type Cost Function for Mixed H?/H 0 c - 

Control Design 

The previous section motivates a parametrization of the worst-case //.^-disturbance in the 
form of a state feedback w(t) = Kx[t). It should be noted, that other parametrizations are 
also possible. We could, for example, assume that w is generated by an independent linear 
system (an open-loop parametrization) or a factorization w{t) — in the definition of 

a frequency- domain cost function. The state-feedback characterization, however, has proven 
to provide many desirable connections to the H :< - bound problem. 

In this section we propose a LQ-cost function that represents the mixed H 2 j // x , -bound 
control problem. 


6.1 The One Disturbance/Two Criterion Case 

The system under consideration represents the most general case of the one disturbance 
input/two criterion output case. Let 


V x /2 


Ax + B\W + S3 u, f( 0) — x 0 
C \ x + D ] | w + D 1 3 u 
C 2 x + D 2 \w + D23U 
C3X + D sl w + D 33 u 


2 


(145) 
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where it is assumed that the system uncertainties are all lumped into one A-block already, 
namely w = A: Kl with \\l±\\co < where a is some positive constant. Note that the small 
gain theorem then provides robust stability as long as the //oo-norm of the transfer function 
from w and ^ is smaller then y. Furthermore the following assumptions are made: 


Al: (A, Si) and (A, B 3 ) are controllable pairs, 

A2: (Ci, A), (C'V A) and (C 3 , A) are observable pairs. 

The compensator is assumed to be proper with the general structuie. 


Sr : = 


x c — A c x c T 5 c y, x c (0) x c q 
[ u = C' c x c + D c y 

For the H ^.- part of our cost function the disturbance w is parametrized in the foim 


(146) 


w = A i .r + A 2 -i ' c = A 
Define furthermore the two subsystems. 


,r 

X r 


(147) 


f x — Ax + B x w + B 3 u, ; 

c(0) - x 0 


S 2 : = s 22 = C]X + D xx w -f- D x3 u 


(148) 

( y = C 3 x + D 3x w + D 33 u 



( x = Ax + B x w + B 3 u, 

O 

H 

II 

O 

C-i 


E x :=< Zoo = C 2 x + D 2 i w + D 23 u 


(149) 

| y = C 3 x + D 3x w + D 33 u 




Then the closed-loop system with the compensator in place has the following form 


v l/2 
^Scl *— 


x c i — AciXd + BdW, c/ ( 6 ) x c iq 

-2 = C\ c [X c i + D Uc iiv 

Z, x , ~ (-2cl x cl + D 2 ldW 


where 
x c i = 

( A + B 3 (I - D C D 33 )~ ] D c C 3 BA! - D c D 33 )~ 1 C c 

‘^ cl ~ y B c C 3 + B c D 33 (I — D c D 33 )~ ] D c C 3 A c + BcD^il — DcD^) C c 

„ _ ( B x + B 3 (I - D c D 33 )~ l D c D 3l \ 
bd ~ I, D 31 + D 33 (I - D c D 33 y l D C D 3X ) 

Cid = ( C, + D X3 (I - D c D 33 )- x D c C 3 D x3 (I - D c D 33 )~ l C c ) 

D\\ c i = ( B xx -F D X3 (I — D c D 33 ) D c D 3X ^ 



(150) 
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C-2d = ( C 2 + D 2 :i{I — D c D33 ) 1 D c C'z D ai] - D C D^) 'C.- ) 
D2ici — ( ^21 + Dttil — D C D%})~ 1 D c D;n ^ 

Let C 0 denote a matrix 


that contains all the compensator matrices. Now the cost function can be defined to represent 
the mixed H 2 / -criterion. To do that, we define the two separate cost functions J 2 (C 0 , </), 
h\tj) as follows. 

Definition 6.1 Define 

J 2 (C 0 Jj) = e\zJ(t.f)Qz 2 (tj) + (150 

subject to the system £2 ■ tAc compensator £ c , u’/i/fe noise with unit spectral density , 

Q = Q T > 0 , /?! = > 0 o/trf tht constraint |C 0 ,J < M c ViJ, inhere M c is an upper 

bound for every entry in Cq. 


Definition 6.2 Define 

j*(C u, w. tj) = J~(C 0 . A'C/) = J ‘ ( 2 .x, (0«*(0 - 7 2 u ,T (LM*)]<fr ( 15 ‘ 2 ) 

subject to the system « /? r/ //?e co X c ■ U Q certain controller Cq is given, 

perform the preliminary transformation w(t) = (7 2 / — Dj lc (Dud) ] [Dj ]c iC\ c ix(t) + B c iw(t)], 
w(t) = I\x cl (t), K = l\ T > 0 and |A^| < M f < Vi, where M K is an upper bound on all 
entries of A. 

With all these preliminaries we now can finally state the cost function: 

Definition 6.3 Assume a system and a compensator Sc* Then the cost Junction foi 

a mixed H 2 j - design is defined as Jollows, 

J 2 /oc ‘{Co, I\) = min { ^lirn^ J 2 {C 0 .tf)} + (1 - J~(C 0 , A' , //)] } ( 153 ) 

subject to D Ucl = 0 for boundedne ss of J 2 (Co, 00), 

0{D 2 id) < 7 - 

(/ — D c Dyf) is nonsingular for well posedness, 

([C 2c / + D 2 lc ,I\] T [C 2c i + D nd K] - 7 2 K t K) > 0 VCo for non-negativity of the cost function, 
(A c i, B c [) is a controllable pair, 

(C\ c i,A c i) and {C 2c h A c i) are observable pairs, CltDnd — 0’ D 2lc i — 0 
and 3 € [0, 1]. 
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6.1.1 Interpretation of the Cost Function and Comments 

1. In general the cost function represents the weighted sum of a weighted /^-criterion 

J 2 {CoJf) and a H ^- bound criterion That is, having chosen a 7, the 

design based on this cost function attempts to minimize the H 2 - norm from w to z 2 
while satisfying the //^-norm-bound from w to z 0 0 by ‘minimizing’ J°°(Co, A ) to a 
finite value (in the limit for t j — ► •00). Note, that - in the limit as t f — ► 00 - J 2 ^°°(C 0 , K) 
will be unbounded if either the design yields an unstable system or the //00-bound is 
violated. If J 2 / X (C 0 . K) is finite, we know that the design achieved a stable closed- 
loop system with an /A*, -norm from w to 2,-0 larger then 70, the minimal H ^- norm 
achievable with state feedback. The algorithm proposed in the next chapter will give 
more insights into this problem when general compensator structures are considered. 

2. The set of all feasible compensators can be characterized as follows: 

“A compensator £ c js feasible if the compensator yields a finite value for J 2 '°°(Co, A')-” 
This characterization can be based on Theorem 5.5 or on the algorithm used for the 
actual computation of the compensator, namely a sequence of minimizations and max- 
imizations. The set of feasible compensators can then be motivated by Theorem 5 . 4 . 

3 . The cost function as posed represents a ‘simultaneous mixed //i/ //^-bound-approach’. 
That means, it represents an unconstrained optimization problem (unconstrained in 
the H~^- sense), as both objectives are explicitly contained in the cost function. The 
design objectives can be summarized in the following form: 

“Find a controller that internally stabilizes the system, that furthermore minimizes 
the 2- norm from w to z 2 and satisfies an H ^- norm bound from w to r, 0 .” 

It can be verified now that the set of feasible compensators as defined above satisfies 
these design objectives. 

4 . The assumption D\i c i = 0 is necessary for a finite //2-norm from w to z 2 . 

5 . a[D 2 id) < 7 guarantees that the cost function max;, lim^—^. J x ( C'q . A y tj) is positive 
for a given Co, it furthermore is a necessary condition for the existence of a maximum 
for max w J* (C 0 , w, tj). It is easily seen that in the case of a strictly proper compensator 
it is necessary for HC^wjloo < 7 that o‘(£> 2 1) < 7 - 

6. The observability and controllability assumptions A1 and A2 as well as the orthogonal- 

ity assumptions in definition 6.3 assure that there is a .r c ;(0) such that the cost function 
J°°(Co, will grow unbounded when the // rX ,- bound is violated (unbounded in the 

limit as tj -+ 00). The controllability assumptions are also necessary for the system 
to be stabilizable by u and disturbable by w while the observability condition assures 
that there are no unstable hidden modes unaccounted for in the cost function. 

7 . The assumption ([CV-j + D 2 id A ] T [C2d + D2U1K] ~ 7 2 A T A ) > 0 VCo is a suffi- 

cient condition for min Co lim^-.^ ./^(C 0 , I<Jj) to be non-negative for a given I\. 
Without this assumption the minimization of K, tj) might result in a nega- 

tive infinite function value. Cases can be constructed, where only a small adjust- 
ment of the controller parameters results in a negative infinite cost (without re- 
ally changing the dynamics of the compensator during the minimizations). Since 
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our approach is gradient based (a sequence of minimizations and maximizations) 
the case could arise where the cost function o- A) alternates indefinitely be- 

tween a large negative cost (when the minimization is performed) and a large positive 
cost (when the maximization is performed) without convergence. The assumption 
{[C-2d + D2iciI\'] T [C2ci + D 2 iciK] - -) 2 K T K) > 0 VCo excludes this case. 

S. J 2 / X '(C 0 , K) is continuous in I\ as well as in Co as long as (/ — D c Da) is nonsingular. 
If continuity problems arise in the algorithm we can always assume D33 = 0 for the 
design and then reincorporate D33 if the final design for the plant with D33 = 0 is well 
posed (see [66] section 5 . 5 . 2 ). It 

9 . The restriction on the entries of Co and A guarantees that the domains for Co and A 
are closed and bounded. This restriction also avoids the 'infinite gain case 1 . That is, 
no element of C 0 or A can grow unbounded. 

10 . l 3 is a weighting factor that allows a mixing of the H^- bound- and /^-criteria. In 
the limiting cases (T = 1 and 3 = 0) the implications for the optimization problem 
are obvious, namely the reduction of the cost function to either a pure H 2 - problem 
or a pure f/. x -bound problem. However, as pointed out in the results due to Doyle, 
Zhou and Khargonekar, the mixed H ± / //^.-problem as stated is solvable it and only 
if the pure Z/ lX ,-bound problem has a s olu tion. Thus, at this point the implications of 
3 G (0,1) are not completely clear, practical designs and their dependence on 3 will 
be considered. 

11. The cost function allows an optimization of the /^-criterion over noise distributions 
other than white noise by using shaping filters. 

12. If an additional '/-iteration is included in the algorithm, the true mixed 
problem can also be addressed. Furthermore, if structural knowledge about A is known 
the //-synthesis problem can be addressed by introducing appropriate unitary scaling 
matrices (see e.g. [12]). 

13 . The cost function ./ 2/r>0 (Co. A') is not concave in A', nor is it convex in C 0 . At least no 
proof has been found so far that it is concave in K. This raises the question if there 
is a different parametrization of the worst case //.^-disturbance that forms a concave 
optimization problem. 

6.2 The Two Disturbance/One Criterion Case 

The above considerations can be applied to the two disturbance input/one criterion output 
case. Here we consider the most general system with two disturbance inputs and one criterion 
output, 




y 


Ax + 5] W 2 T B 2 Woo + B 3 U, x(0) = X 0 

C\ x + D u w 2 + Dx 2 w. x , + D\3U 
C3X + D31W2 + -D32WC0 T D33U 


( 154 ) 


47 


with the additional assumptions 

Al’: (A,Bi) for i= 1,2,3 form controllable pairs, 


A2’: (Ci,, 4) and (C 3 , .4) form observable pairs. 

The compensator for this case is assumed to be of the same form as in the one distur- 
bance/two criterion case. Forming the closed loop system with the compensator in place 
yields 


where 


v 2 / 1 — 

^Scl •“ 


■I’d 


A C [X C 1 + B\ C I U' 2 + B-2clW ooi ;! 'cf (0) -T do 

Cl d^cl + D\\ C {W 2 + Dl2d w oo 


(155) 


- ( A + B 3 (I - D c D 33 )~ l D c C 3 B 3 (l - D c D 33 )~ l C c \ 

Ael - { B c C 3 + B 2 D&{r- D c D 33 )-'D c C 3 A c + B 2 D 33 [I - D C D 33 ) l C c ) 

p _ ( Bi + S 3 (/ — D C D 33 )~ X D c D 3 i \ 

Hul ~ \ B c D. n + B 2 D 33 (I - D c D 33 )~ x D c D 3 \ ) 

_ ( B 2 + B 3 {I- d,d 33 )- 1 d c d 32 

U ' 2d ~ \ B c D 3 2 + B 2 D 33 (I - D c D 33 )- l D c D 32 ) 

Cut = ( C] + D yi (I - D c D 33 )-'D c C 3 Di 3 (I - D c D 33 ) l C c ) 

D\id ~ ( D n A D, 3 (7 — DcD 33 ) 1 D c D 3 \ 'j 

Dud = ( D v2 + D\ 3 (I — D c D 33 )~ x D c D 32 ) 

The cost function for mixed H 2 /H ^,- control is similar to the one defined above. However, 
here z plays the dual role that w played in the one disturbance/ two criterion case. 

Definition 6.4 Consider the system and the compensator E c . Then the cost function 

for a mixed H 2 / H ^-design is defined as follows 

j 2 /°°(Co, K) = min max lim [ [z T (t)z(t) — ') 2 w^ 0 (t)w. Xi (t )]dt (156) 

C 0 U'2 , A t f —* >70 J o 

subject to D U d = 0, a(D l2cl ) < j, {I - D C D 33 ) is nonsingular and w^{t) = Kx d {t) and 
w 2 (t) white noise with unit spectral density. 

Note that this definition represents the ‘key cost function’ for our design approach to the 
mixed H 2 /H c 0 problem. Additional assumptions have to be included in order to avoid 
negativity of the cost function or unobservability/uncontrollability. This cost function has 
similar interpretations as those given in the one disturbance/two criterion case and are 
omitted here. 
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7 Algorithm For The Proposed Mixed H-i/H ^-Control 
Design 

As mentioned in the introduction, the setting is that of a finite time with an LQ-type cost 
function for the mixed Hij H, 0 ^optimization. This finite time setting has the advantage that 
all defined LQ-type cost functions are well defined. In the limit as tj — > oc, time domain 
functions can only be expressed in terms of Lyapunov and Riccati equations. This formu- 
lation has the ‘advantage’ that, in the steady-state form, it recovers the problem associated 
with Riccati-based approaches. The approach taken here follows [23] in which a certain pre- 
specified compensator structure is chosen (not necessarily of the same order as the plant). 
Starting at a small t /, this compensator structure is optimized with respect to the worst-case 
disturbances. Once an optimized solution for the compensator has been found, t j is increased 
and the process repeated. The design procedure eventually settles to a tj representative of 
the steady-state condition. Even if the final result of the algorithm does not yield a feasible 
compensator, we still can make statements about the resulting closed- loop system based on 
the individual values of J x (Co- A’, tj) and J 2 (C 0 , KJj) and their 'time-histories’. 

Attention in this section is restricted to the one disturbance/two criterion case, an equiv- 
alent. algorithm can be defined for the dual case of two disturbances and one criterion output. 
Note, that the problem 

min max li m J (C 0 , A . t /) (157) 

C'o K tf — OC 

as stated in Definition 6.2 is a true min-max problem added to the pure /Q-problem. For 
the Hy problem we already know that the worst-case disturbance is white noise so that the 
Hi- part of the problem is actually only a min-problem. 

A complete derivation of the pure H ,^- bound problem in terms of game theory has been 
presented recently by Rhee and Speyer in [42], Solutions are given in terms of two ARE s 
(the same as derived in the DGKF paper). A complete analytical treatment of the mixed 
Hi/H^- bound problem in game theoretical terms, however, is still missing. 

As discussed earlier, there is no guarantee tor the existence of a saddle point solution for 
the min-max problem as posed by J 2 ^{Co, A ). The algorithm used here is the algorithm 
as suggested by Salmon (see Chapter 2) that is modified to suit our problem formulation. 
It searches for min-max optimal strategies in the sense of definition 2.14. The assumptions 
made in the last chapter assure that the optimization problem is continuous in Co and A 
with closed, bounded domains. No further assumptions are made. The algorithm and a flow 
chart, for the actual design are outlined as follows. 

The Algorithm: 

1. Initialization: 

Choose initial tj 0 , C'o (not necessarily stabilizing), .r 0 , .r c (0). 7, ft. Q and R\ . 

Select an initial set A 1 = {/\ l . A’ 2 , ..}. 

Set n — 1, i = 1. 
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2. n th min-max iteration for tj — tj t : 

If A ct is unstable let ,3=1, otherwise let /3 = ,3. 

Perform a minimization with respect to Cq as stated in Definition 6.3 foi all A G A.' . 

min{/)[J 2 (C 0 , t ji)] + (1 - .i ) [ max J >: ( C 0 (loS) 

C’o 

Let the minimizing compensator be denoted by C$. 

Compute = max/ v - 6 £ n J 2 ^°°(6o, A,//;) 

Perform a maximization with respect to A as stated in Definition 6.2 

max J^(C^Kj Jt ) (159) 

A 


and let the maximizing I\ be denoted by K n . 
Compute = J^(C^h\t fl ). 

Form AC n+1 = A' n U {A' n }. 


3. Termination criterion for t f = tj,\ 

If I ~ J'n-Atj .) I > let 11 = 11 + l ' 1 = ^ gO tO Step 2. 

If I J?(tfi) - J"l, (*/,-)! < c- compute + Jn(hi)} and continue at 

step 4. 


4. General termination criterion: 

If | - jHTVju- d)I ^ £ let ’ */(>'+u 

and continue at step 2. 


t j, + A^tj, i — i + 1, n — 1, C 1 — All 


if - JfiTihu- 1>)I < * st °P- 


,2/x 


Comments: 

1. Pure continuity of J 2/cc (Co, A') in C 0 and A' is sufficient for J^Aji) to be unbounded 

as t f oc if the bound is violated and for to be a monotonically in- 

creasing function of n (the latter fact is ascertained by the optimization over an in- 
creaasing set A J). From the considerations in Chapter 2 we also know that </; (t/i) 
is an upper limit for minc 0 max/y J 2y,cc (C 0 ; A , tj,) and is a lower limit for 

min Co max/c J 2 ' X '{C 0 , 

2. Let us look at the possible outcomes of this algorithm in the limit as t j — * oc: 

• unbounded and unbounded or, converges and </*'(*/•) 

unbounded. Then the H ^- bound is violated and/or the closed-loop system is 
unstable. 

• converges and converges but i 1 Then the system 

is asymptotically stable and the H^-bound is satisfied. 

• •/'" (tj t ) converges, Jn(tji) converges and J™{tjA = JnAjA'- 

The system is asymptotically stable and the bound is satisfied and the strate- 
gies represent a saddle point if the optimal C 0 and I< are in the interior of then- 
respective domain. 
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Figure 2: Flow Chart of Design Algorithm 
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Theoretically there could also be the case of 'limit oscillations of meaning 

that does not diverge, but it does not converge to one value either. The 

system is asymptotically stable and the //x,-bound is satisfied in this case. The actual 
implementation will show whether this case is relevant and has to be included into 
the general framework. These possible cases show that the goal is not necessarily the 
finding of a saddle point but rather w T e seek the ‘boundedness’ of and J n [tj ,) 

in the limit as tj — * oo. A saddle point strategy is a special case of all the possible 
strategies that satisfy our design goals. 

3. Note, that the algorithm as shown assumes that a stabilizing solution exists, that 
satisfies the //^-bound. Other 'checks have to be incorpoiated to detect all possible 
cases as described above. The algorithm as presented shows the schematics and the 
most important steps only. 

4. If the above scheme turns out to be computationally too costly, (Note: all previous 
computed K have to be stored) then a secjuence of pure maximizations and minimiza- 
tions (without retaining previous I\) will be applied. This would be equivalent to 
finding the worst-case disturbance for an existing system followed by a reoptimization 
of the controller with respect to these disturbances. This approach has been used for 
example by Rhee and Speyer in [40]. 

5. Note that the optimization problem as stated here allows the worst-case //»■ 
disturbance to be unbounded, if a characterization of the //^-disturbance w with 
w 6 L 2 is desired (see e.g. [47]), then this can be incorporated by constraining the 
maximization steps to an asymptotically stable closed-loop matrix A c i (with the max- 
imizing w in place). 

6. If the closed-loop system for a certain controller is unstable, then only an H 2 - 
optimization will be performed until a compensator is found that stabilizes the plant. 
// will perform the selection. 

7. The algorithm does, not guarantee stability or the //*,- bound for the actual limit as 
lj _> QQ. Hence, after the design procedure has been terminated at the largest finite 
time tj that can be implemented on the computer, stability has to be checked via 
the eigenvalues of the closed-loop A-matrix, A c i, and using the ARE to examine 
whether the actual design specifications have been met. 

S. The optimization will be embedded into the design tool SANDY and thus uses a 
gradient- based method to achieve extrema. This however does not necessarily guaran- 
tee a global optimum. 

9. As the cost function is not convex in Co nor is it concave in A , this approach represents 
a controller design with worst-case //^-disturbance achievable by the initial guesses of 
I\ and Cq. 
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8 Summary and Concluding Remarks 

The pure -bound control problem has been solved in algebraic and game theoretical 
terms. Connections have been developed in the last technical report (see [24]). On the 
other hand, the mixed f/ 2 ///. ; 0 -bound control problem can be viewed as a combination of 
a stochastic and deterministic game (see e.g. the results of Doyle, Zhou and Bodenheimer 
in Chapter 1). An algebraic solution cannot be derived as easily as in the pure H^, case. 
A formulation in terms of a LQ-type cost function is still possible in mixed H 2 /H x control 
problems where we have to optimize over two different types of disturbances. Solution using 
standard Lagrange multipliers has to be extended to cover this case. This is a topic of 
ongoing theoretical research in this field. 

A frequency-domain cost as defined in section 6.3 of [24] seems to be promissing for the 
definition of a mixed H 2 /H,- 1C cost function. This approach, however, will not be pursued 
further here. Rather, we will concentrate on the approach as presented in this report. The 
proposed formulation offers many insights into the mixed H 2 / bound control problem 
and has many close connections to the algebraic approaches of other researchers as discussed 
in Chapter l. A frequency-domain parametrization of the worst-case // x , -disturbance as in 
section 6.3 of [24] cannot provide these properties. 

The approach presented here, uses a parametrization of the worst-case H. x -disturbance 
in the form of w = A r to formulate a cost function that represents a. mixed H 2 
bound control strategy for the most general two disturbance/one criterion as well as the one 
disturbance/two criterion case. 

The approach combines a weighted //^-criterion with a /L, x , -bound criterion using a sin- 
gle cost functional. The problem of mixed H 2 j /f-x "Control as posed by the cost function 
J' 2 /co (Gj, I<) furthermore represents a ‘simultaneous mixed H 2 j //^-bound-approach’. Ex- 
tensions to an actual mixed H 2 j // x -design and ^-synthesis can be included. The embedded 
//^-problem can be optimized with white noise as driving disturbance or other noise distri- 
butions. 

The assumed compensator structure is the most general (proper or strictly proper), the 
controller order can be chosen freely. The initial guess for the compensator need not be 
stabilizing. 

The presented algorithm is well defined for every finite time tj , and represents a. compu- 
tational way to solve the min- max problem not in terms of a saddle point solution but in 
terms of a ‘bounded game value’ if it exists. 

The formulation of the mixed H 2 jH <x> - control problem as a finite time min- max problem 
using parameter optimization methods represents a new, non Riccati-based approach in 
mixed H 2 j H^-bonnd control. 


9 Outline of Further Research 

1. Implementation of the algorithm and creation of a test-bed for the defined cost function. 

2. Test on sample plants and comparison with Riccati-based designs. The comparison will 
be performed on an analytical basis by comparing the I\ that generates the worst-case 
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//^-disturbance with the solution of the according ARE. Further analysis will include 
maximum singular value plots and the achieved // 2 -norm. 

3. Extension and application of the proposed scheme to the general "two disturbance 
inputs/two disturbance output”-case. As long as cross-couplings are neglected, this 
generalization does not pose a significant problem with the defined cost function as we 
can define two independent systems for the H 2 - and H ,^- objective (both systems share 
the same controller). 

4. Simplification of the general system assumptions for a ‘two disturbance inputs/two 
criterion outputs’ and relaxation of the imposed constraints (such as orthogonality 
conditions or observability/controllability conditions). This task will be performed in 
the spirit ol Safonov (see [44] or [66]) by using preliminary state, control and distur- 
bance transformations. 

Possible Extensions and Long Term Goals: 

1. Inclusion ot a * -iteration tor an actual minimization of the according // lX ,-norm. 

2. Extension to //-synthesis it the A-block has a structure. 

3. Actual definition of a strategy for the “two disturbance inputs/two disturbance 
output”-case, taking cross-couplings into account. 

4. Modification of the defined cost function to incorporate CLTR-tvpe designs. 

5. Possible use of genetic algorithms to solve the posed optimization problem. 

6. Extension to a general mixed ffx/H ,^,- synthesis framework. 

Work in Progress: 

E. Schoemig and Uy-Loi Ly, "Mixed H 2 ! H, x , Control with an Output-Feedback Compen- 
sator Using Parameter Optimization, To be presented at the 1992 ACC Conference, Westin 
Hotel, Chicago, IL, June 24-26, 1992. 
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